-- Logs begin at Sat 2022-06-04 17:42:34 UTC, end at Sat 2022-06-04 18:51:50 UTC. -- Jun 04 18:14:06.798801 dv-cinder-790535-41-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 04 18:14:06.808033 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 04 18:14:06.809570 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 4 18:14:06 2022] *** Jun 04 18:14:06.809570 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 04 18:14:06.809570 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 04 18:14:06.809570 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: nodename: dv-cinder-790535-41-iscsi Jun 04 18:14:06.809570 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: machine: x86_64 Jun 04 18:14:06.809570 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: clock source: unix Jun 04 18:14:06.809570 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: pcre jit disabled Jun 04 18:14:06.809570 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: detected number of CPU cores: 4 Jun 04 18:14:06.809570 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: current working directory: / Jun 04 18:14:06.809570 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: detected binary path: /usr/bin/uwsgi-core Jun 04 18:14:06.810085 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: your processes number limit is 47680 Jun 04 18:14:06.810085 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: your memory page size is 4096 bytes Jun 04 18:14:06.810085 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: detected max file descriptor number: 2048 Jun 04 18:14:06.810085 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: lock engine: pthread robust mutexes Jun 04 18:14:06.810085 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: thunder lock: enabled Jun 04 18:14:06.810085 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 04 18:14:06.810085 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 04 18:14:06.853549 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: Python main interpreter initialized at 0x55ce72a989c0 Jun 04 18:14:06.853549 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: python threads support enabled Jun 04 18:14:06.853549 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: your server socket listen backlog is limited to 100 connections Jun 04 18:14:06.853549 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: your mercy for graceful operations on workers is 90 seconds Jun 04 18:14:06.853921 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: mapped 403077 bytes (393 KB) for 2 cores Jun 04 18:14:06.853921 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: *** Operational MODE: preforking *** Jun 04 18:14:06.854241 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: *** uWSGI is running in multiple interpreter mode *** Jun 04 18:14:06.854241 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: spawned uWSGI master process (pid: 80204) Jun 04 18:14:06.854454 dv-cinder-790535-41-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 04 18:14:06.854989 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: spawned uWSGI worker 1 (pid: 80214, cores: 1) Jun 04 18:14:06.855328 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: spawned uWSGI worker 2 (pid: 80215, cores: 1) Jun 04 18:14:06.856888 dv-cinder-790535-41-iscsi devstack@keystone.service[80204]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 04 18:14:12.465898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:14:12.465898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: from cryptography.utils import int_from_bytes Jun 04 18:14:12.466780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:14:12.466780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: from cryptography.utils import int_from_bytes Jun 04 18:14:12.469116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:14:12.469116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: from cryptography.utils import int_from_bytes Jun 04 18:14:12.469615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 18:14:12.469615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: from cryptography.utils import int_from_bytes Jun 04 18:14:12.516870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 18:14:12.517058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 18:14:12.517192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] command line args: [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 18:14:12.517489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 18:14:12.517628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ================================================================================ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 18:14:12.517791 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 18:14:12.517884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] admin_token = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.517995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 18:14:12.518114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config_dir = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.518195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] command line args: [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 18:14:12.518312 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.518422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 18:14:12.518502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config_source = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.518613 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ================================================================================ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 18:14:12.518693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] debug = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.518841 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] admin_token = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.518927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config_dir = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config_source = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] debug = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_config_append = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.520942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_dir = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_config_append = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_dir = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521621 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.521862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.522046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.522119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.522177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.522240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.522444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.522574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.522574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.522775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.522850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.522976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.523051 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.523169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.523248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.523318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.523393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.523547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.523666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.523753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.523834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.524049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.524237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.524329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.524545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.524666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.524761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] publish_errors = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.524834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.524965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.525161 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.525288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.525381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.525459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] publish_errors = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.525534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.525685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.525805 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.525897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.526029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] standard_threads = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.526108 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.526183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.526253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.526457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.526587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.526673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.526744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] standard_threads = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.526817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_journal = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.526911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.527006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_json = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.527077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_stderr = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.527158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.527229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_syslog = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.527296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.527491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.527624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_journal = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.527624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_json = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.527766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.527836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_stderr = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.527947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.528071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_syslog = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.528235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 18:14:12.528368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.528447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.528523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.528710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.528842 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.528922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.528998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.529203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.529294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.529482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.529691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.529782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.529960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.530081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.530181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.530308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.530403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.530569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.530690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.530798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.530880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.531052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.531149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.531297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.531376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.531551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.531677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.531751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.531829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.531998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.532097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.532265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.532343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.532509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.532602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.532743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.532823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.532994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.533078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.533244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.533329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.533488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.533566 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.533717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.533794 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.533946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.534036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.534173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.534251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.534407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.534486 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.534654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.534740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.534897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.534975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.535106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.535180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.535333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.535488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.535562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.535629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.535797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.535872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.536064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.536157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.536279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.536354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.536506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.536587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.536738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.536818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.536971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.537046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.537200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.537317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.537440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.537553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.537661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.537775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.537884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.537991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.538106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.538217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.538324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.538437 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.538532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.538622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.538721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.538813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.538947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.539048 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.539183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.539284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.539417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.539523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.539644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.539743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.539855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.539969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.540102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.540214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.540360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.540816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.540927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.541026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.541141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.541255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.541366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.541484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.541594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.541703 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.541810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.541924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.542034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.542133 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.542240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.542349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.542467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.542589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.542708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.542826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.542936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.543055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.543166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.543282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.543399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.543515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.543625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.543742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.543858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.543974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.544145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.544258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.544368 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.544478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.544587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.544696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.544896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.545509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.545675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.545796 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.545909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.546029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.546155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.546267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.546377 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.546487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.546635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.546755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.546876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.546987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.547097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.547206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.547315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.547424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.547613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.547728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.547846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.547957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.548096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.548222 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.548335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.548444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.548553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.548664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.548779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.548898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.549008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.549117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.549232 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.549341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.549450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.549567 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.549668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.549783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.549899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.550008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.550118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.550239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.550359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.550480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.550590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.550699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.550809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.550926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.551037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.551158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.551269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.551378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.551489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.551606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.551716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.551834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.551834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.552068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.552183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.552292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.552401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.552523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.552634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.552744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.552853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.552962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.553076 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.553194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.external = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.553194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.553401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.553401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.553605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.553726 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.external = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.553844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.553986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.554109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.password = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.554109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.token = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.554319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.554429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.554538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.554698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.554820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.password = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.554932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.555043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.token = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.555153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.555262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.555385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.555497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.555607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.555717 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.555827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.555937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.556079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.556193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.556310 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.556421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.556532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.556642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.556760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.556871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.556981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.557092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.557202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.557318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.557437 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.557554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.557665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.557775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.557885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.557995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.558114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.558335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.558452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.558563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.558673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.558791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.558912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.559023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.559137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.559248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.559357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.559475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.559587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.559696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.559808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.559919 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.560085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.560209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.560347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.560547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.560723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.560893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.561054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.561344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.561344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.561694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.562028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.562226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.562408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.562571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.562691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.562803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.562914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.563024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.563136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.563255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.563369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.563490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.563601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.563719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.563832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.563950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.564079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.564191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.564302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.564414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.564414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.564414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.564414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.564840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.564840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.565046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.565163 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.565274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.565384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.565496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.565606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.565784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.565964 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.566087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.566201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.566313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.566423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.566536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.566656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.566767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.566878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.566988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.567098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.567209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.567328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.567440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.567553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.567663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.567774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.567884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.568111 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.568234 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.568347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.568458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.568568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.568679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.568804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.568918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.569029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.569138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.569249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.569359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.569478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.569595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.569709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.569820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.569931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.570041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.570159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.570270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.570390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.570502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.570613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.570725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.570843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.570969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.571081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.571195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.571195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.571402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.571524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.571635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.571746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.571856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.571965 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.572094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.572218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.572330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.572440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.572549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.572665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.572777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.572894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.573005 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.573115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.573224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.573333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.573442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.573559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.573671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.573780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.573936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.574047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.574156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.574274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.574386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.574527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.574646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.574756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.574866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.574985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.575103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.575246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.575358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.575487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.575583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.575684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.575779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.575872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.576063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.576211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.576374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.576374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.576698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.576846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.576949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.577044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.577137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.577246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.577342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.577342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.577527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.577620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.577721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.577836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.577947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.578058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.578151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.578244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.578345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.578441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.578533 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.578626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.578720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.578812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.578960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.579146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.579322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.579322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.579608 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.579706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.579809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.579905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.579998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.580118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.580213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.580322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.580444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.580557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.580666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.580782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.580892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.581001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.581122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.581234 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.581343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.581537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.581652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.581762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.581880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.581992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.582101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.582213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.582323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.582434 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.582552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.582663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.582773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.582882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.582991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.583100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.583218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.583330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.583440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.583550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.583660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.583769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.583960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.584117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.584230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.584341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.584451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.584561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.584685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.584798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.584909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.585018 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.585128 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.585238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.585355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.585470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.585580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.585689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.585800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.585909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.586027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.586144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.586256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.586366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.586477 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.586586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.586704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.586815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.586926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.587036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.587147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.587256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.587374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.587486 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.587596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.587705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.587815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.587925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.588059 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.588173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.588283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.588394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.588505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.588615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.588733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.588845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.588954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.589064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.589174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.589292 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.589403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.589513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.589624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.589624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.589830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.589948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.590061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.590171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.590281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.590391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.590501 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.590620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.590730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.590840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.590950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.591059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.591172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.591290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.591402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.591512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.591664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.591783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.591893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.592065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.592286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.592512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.592627 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.592738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.592849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.592972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.593084 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.593194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.593303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.593414 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.593524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.593643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.593756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.593866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.593982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.594115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.594229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.594347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.594458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.594568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.594678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.594788 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.594906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.595018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.595128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.595238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.595347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.595456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.595573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.595684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.595793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.595928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.596060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.596217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.596450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.596568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.596699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.596811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.596922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.597056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.597178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.597289 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.597399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.597536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.597649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.597759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.597877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.597990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.598101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.598211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.598321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.598431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.598548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.598680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.598794 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.598913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.599033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.599145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.599276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.599419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.599541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.599681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.599803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.599923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.600065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.600178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.600287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.600410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.600523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.600633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.600744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.600853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.600963 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.601081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.601193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.601303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.601413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.601527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.601637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.601760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.601872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.601982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.602092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.602203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.602312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.602495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.602608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.602718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.602828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.602938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.603047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.603047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 18:14:12.603266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.603376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.603540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.603774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 18:14:12.603943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 18:14:12.633345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.633573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.633797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.634259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.634492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.634716 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.642656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.643769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.671400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.671626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.673407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.673613 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.725066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.725343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.773867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.774092 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.774970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.775187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.840438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.840602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.840807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.841024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.841237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.841447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.841599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.841738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.842450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.842686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.842908 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.843123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.864577 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.864865 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.865008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.865088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.865238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.865362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.865497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.865589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.865711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.865787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.865848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.865961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.866166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.866372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.876920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.877432 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.889738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.890018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.890158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.890396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.890517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.890655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.890747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.890874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.890950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.891012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.891195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.891408 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.891625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.891834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 18:14:12.908403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.908615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 18:14:12.908952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.909092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.909228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 18:14:12.909307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 18:14:12.909425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.909538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.909649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.909734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 18:14:12.909883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.910005 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.910139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.910218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.910465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.910715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.921326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.921570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.921859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.922018 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.922305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.922428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.922554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.922831 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.930386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.931060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.933678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.933950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.934226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.934347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.934496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.934582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.934772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.934895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.935014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.935096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.935280 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.935444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.935540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.935830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.935951 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.936137 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.936569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.936693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.936829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.937106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.937380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.937649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.964352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.964811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.965972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.966250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.966390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.966762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.971844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.972149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.972440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.972670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.972945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.973220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.979758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.980031 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.980568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.980848 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.984624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.984905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.985189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.985480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.985752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.985951 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:12.986049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.986246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.986368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.986516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.986637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.986826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.987107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.987376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.987639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:12.988032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.005360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.005646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.007075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.007351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.010341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.012041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.014074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.014384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.016372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.016665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.019371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.021638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.023006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.025219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.026653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.026949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.027230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.027509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.027798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.028218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.028865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.029175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.029938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.030222 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.030500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.030768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.047663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.047913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.048232 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.048494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.050647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.050925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.051198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.051460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.057813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.059282 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.059593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.059867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.061690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.061930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.062954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.063237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.063514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.063794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.064071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.065012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.065292 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.065569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.065854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.066139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.077454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.077729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.078004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.078280 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.078556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.078825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.079099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.081201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.081480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.081764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.082030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.082332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.082595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.082868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.096990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.100348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.101235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.103646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.104490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.105265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.106887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.107165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.107488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.108531 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.110155 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.111765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.112057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.112334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.114785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.116538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.119690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.119833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.119970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.120309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.120583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.121320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.124900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.125187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.125469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.125756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.129683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.129969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.130245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.134780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.135064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.135349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.138249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.138581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.138882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.139154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.139420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.139695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.139973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.140264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.140540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.140804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.141069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.141321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.141595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.141850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.143854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 18:14:13.144158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.144435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.144707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.144979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.145246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.145522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.145802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.146082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.146353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.146618 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.146889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.147130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.147387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 18:14:13.180135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ce72a989c0 pid: 80215 (default app) Jun 04 18:14:13.183416 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3efb9-4392-4ac7-953e-de2207a96107 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:13.183707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3efb9-4392-4ac7-953e-de2207a96107 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:13.183981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3efb9-4392-4ac7-953e-de2207a96107 None None] PATH_INFO: `/v3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:13.186441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ce72a989c0 pid: 80214 (default app) Jun 04 18:14:13.188346 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Sat Jun 4 18:14:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:21.251792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b97d-71ca-403f-bbae-d295b5ca8d96 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:21.252732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b97d-71ca-403f-bbae-d295b5ca8d96 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:21.252732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b97d-71ca-403f-bbae-d295b5ca8d96 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:21.259717 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:21 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:21.265523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:21.265958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:21.266046 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:21.334191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: INFO dbcounter [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] Registered counter for database keystone Jun 04 18:14:21.356086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG oslo_db.sqlalchemy.engines [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:14:21.367275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writer thread running {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:14:21.671495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG passlib.handlers.bcrypt [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80215) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 04 18:14:21.671924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG passlib.handlers.bcrypt [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80215) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 04 18:14:21.728198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:21.729901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:21.871973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 04 18:14:22.067671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916b97d-71ca-403f-bbae-d295b5ca8d96 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:22.141443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: INFO dbcounter [None req-e916b97d-71ca-403f-bbae-d295b5ca8d96 None None] Registered counter for database keystone Jun 04 18:14:22.162893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG oslo_db.sqlalchemy.engines [None req-e916b97d-71ca-403f-bbae-d295b5ca8d96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 18:14:22.171307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writer thread running {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 18:14:22.399818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916b97d-71ca-403f-bbae-d295b5ca8d96 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:22.405302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f878b1d-7788-401d-9463-fb7a65f7dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:22.405997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878b1d-7788-401d-9463-fb7a65f7dac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:22.406279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878b1d-7788-401d-9463-fb7a65f7dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:22.406560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f878b1d-7788-401d-9463-fb7a65f7dac8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:22.415683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f878b1d-7788-401d-9463-fb7a65f7dac8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:22.467731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5f878b1d-7788-401d-9463-fb7a65f7dac8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 04 18:14:22.468070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f878b1d-7788-401d-9463-fb7a65f7dac8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:22.478489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Sat Jun 4 18:14:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:14:22.486003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:22.505454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb7f78-a80a-4b88-9b67-831250580e5d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:22.511929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce83c4b-b51b-4f7c-8c9d-d1ea2ad947e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:22.513135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83c4b-b51b-4f7c-8c9d-d1ea2ad947e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:22.513418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83c4b-b51b-4f7c-8c9d-d1ea2ad947e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:22.513969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83c4b-b51b-4f7c-8c9d-d1ea2ad947e1 admin admin] PATH_INFO: `/v3/projects/b474e20b865e43bf8fbbb839d2f225c5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:22.515555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce83c4b-b51b-4f7c-8c9d-d1ea2ad947e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=b474e20b865e43bf8fbbb839d2f225c5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:22.566251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0ce83c4b-b51b-4f7c-8c9d-d1ea2ad947e1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 04 18:14:22.566592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce83c4b-b51b-4f7c-8c9d-d1ea2ad947e1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:22.572453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Sat Jun 4 18:14:22 2022] GET /identity/v3/projects/b474e20b865e43bf8fbbb839d2f225c5 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:24.852582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d88fd4-ae42-4b81-83ff-9aa1e54988c8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:24.853127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d88fd4-ae42-4b81-83ff-9aa1e54988c8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:24.853127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d88fd4-ae42-4b81-83ff-9aa1e54988c8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:24.857301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:24.864952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07362b5-29e4-4f8e-86fb-14afed20d58b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:24.865639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07362b5-29e4-4f8e-86fb-14afed20d58b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:24.865840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07362b5-29e4-4f8e-86fb-14afed20d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:24.894539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a07362b5-29e4-4f8e-86fb-14afed20d58b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:24.896066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a07362b5-29e4-4f8e-86fb-14afed20d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:24.907017 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 04 18:14:24.930600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d88fd4-ae42-4b81-83ff-9aa1e54988c8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:24.952095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d88fd4-ae42-4b81-83ff-9aa1e54988c8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:24.957652 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fd186-2220-4e85-80f6-bb805ffd40f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:24.958289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fd186-2220-4e85-80f6-bb805ffd40f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:24.958570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fd186-2220-4e85-80f6-bb805ffd40f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:24.958845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fd186-2220-4e85-80f6-bb805ffd40f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:24.966987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fd186-2220-4e85-80f6-bb805ffd40f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:24.968912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fd186-2220-4e85-80f6-bb805ffd40f8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:24.977615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Sat Jun 4 18:14:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:14:24.984613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07362b5-29e4-4f8e-86fb-14afed20d58b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:24.999343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07362b5-29e4-4f8e-86fb-14afed20d58b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:25.008910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184727f-5f17-4311-8f74-7e863c095ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:25.010314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184727f-5f17-4311-8f74-7e863c095ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:25.010800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184727f-5f17-4311-8f74-7e863c095ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:25.011259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184727f-5f17-4311-8f74-7e863c095ceb admin admin] PATH_INFO: `/v3/users/ad4863301fe44ec5b40adc370b3a51b3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:25.013907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184727f-5f17-4311-8f74-7e863c095ceb admin admin] RBAC: Authorizing `identity:get_user(user_id=ad4863301fe44ec5b40adc370b3a51b3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:25.015953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184727f-5f17-4311-8f74-7e863c095ceb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:25.017571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Sat Jun 4 18:14:24 2022] GET /identity/v3/users/ad4863301fe44ec5b40adc370b3a51b3 => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:27.315039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060e72-3daf-4bd7-bd4a-9aef96f7ce4b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:27.315502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060e72-3daf-4bd7-bd4a-9aef96f7ce4b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:27.315602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060e72-3daf-4bd7-bd4a-9aef96f7ce4b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:27.316975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:14:27.322411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77838ab3-f828-4219-8d73-a09862bf7347 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:27.322819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77838ab3-f828-4219-8d73-a09862bf7347 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:27.322914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77838ab3-f828-4219-8d73-a09862bf7347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:27.340744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-77838ab3-f828-4219-8d73-a09862bf7347 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:27.341922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-77838ab3-f828-4219-8d73-a09862bf7347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:27.352698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18772218-e43d-4c35-ac12-4f93385dd895 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:27.352984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18772218-e43d-4c35-ac12-4f93385dd895 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:27.353262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18772218-e43d-4c35-ac12-4f93385dd895 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:27.354591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:14:27.359727 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50de2-6bd4-412d-952a-059c4b930444 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:27.360029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50de2-6bd4-412d-952a-059c4b930444 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:27.360307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50de2-6bd4-412d-952a-059c4b930444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:27.399352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG passlib.handlers.bcrypt [None req-f4e50de2-6bd4-412d-952a-059c4b930444 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80214) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 04 18:14:27.399764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG passlib.handlers.bcrypt [None req-f4e50de2-6bd4-412d-952a-059c4b930444 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80214) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 04 18:14:27.428283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:27.446454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f4e50de2-6bd4-412d-952a-059c4b930444 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:27.448126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f4e50de2-6bd4-412d-952a-059c4b930444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:27.451936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77838ab3-f828-4219-8d73-a09862bf7347 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:27.477154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:27.550357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:14:27.560881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77838ab3-f828-4219-8d73-a09862bf7347 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:27.572572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50de2-6bd4-412d-952a-059c4b930444 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:27.595935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e70be-3daa-42dc-8fc5-ec38d7b58dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:27.596783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e70be-3daa-42dc-8fc5-ec38d7b58dcf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:27.597070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e70be-3daa-42dc-8fc5-ec38d7b58dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:27.597350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e70be-3daa-42dc-8fc5-ec38d7b58dcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:27.609624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e70be-3daa-42dc-8fc5-ec38d7b58dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-973e70be-3daa-42dc-8fc5-ec38d7b58dcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:27.620830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:27.621856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:14:27.622657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:27.627985 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e70be-3daa-42dc-8fc5-ec38d7b58dcf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:27.677563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50de2-6bd4-412d-952a-059c4b930444 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:27.680033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:27.716039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba0b59-2666-4687-b0cb-380f706c463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:27.716287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:27.716995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba0b59-2666-4687-b0cb-380f706c463f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:27.717555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba0b59-2666-4687-b0cb-380f706c463f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:27.717798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba0b59-2666-4687-b0cb-380f706c463f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:27.735390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e70be-3daa-42dc-8fc5-ec38d7b58dcf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:27.768517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bb504-a6a8-4fd1-98a5-8440b8666a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:27.769191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb504-a6a8-4fd1-98a5-8440b8666a90 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:27.769476 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb504-a6a8-4fd1-98a5-8440b8666a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:27.769755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb504-a6a8-4fd1-98a5-8440b8666a90 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:27.770518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bb504-a6a8-4fd1-98a5-8440b8666a90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:27.770834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bb504-a6a8-4fd1-98a5-8440b8666a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:27.772283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bb504-a6a8-4fd1-98a5-8440b8666a90 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:27.783885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:27.785499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba0b59-2666-4687-b0cb-380f706c463f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:27.787053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba0b59-2666-4687-b0cb-380f706c463f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:27.789490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bb504-a6a8-4fd1-98a5-8440b8666a90 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:27.886948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bb504-a6a8-4fd1-98a5-8440b8666a90 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:27.888236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 18:14:27.893963 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba0b59-2666-4687-b0cb-380f706c463f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:27.896682 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:27.924143 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba979c-c00c-44fd-b7ad-82e24558a186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:27.925038 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba979c-c00c-44fd-b7ad-82e24558a186 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:27.925318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba979c-c00c-44fd-b7ad-82e24558a186 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:27.925600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba979c-c00c-44fd-b7ad-82e24558a186 None admin] PATH_INFO: `/v3/users/ad4863301fe44ec5b40adc370b3a51b3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:27.926801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba979c-c00c-44fd-b7ad-82e24558a186 None admin] RBAC: Authorizing `identity:get_user(user_id=ad4863301fe44ec5b40adc370b3a51b3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:27.928315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba979c-c00c-44fd-b7ad-82e24558a186 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:27.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:27 2022] GET /identity/v3/users/ad4863301fe44ec5b40adc370b3a51b3 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:27.935368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba979c-c00c-44fd-b7ad-82e24558a186 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:27.950364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:27.992818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba0b59-2666-4687-b0cb-380f706c463f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:28.029343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d75ad5-23dc-4380-b642-f163b11e54ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:28.030665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75ad5-23dc-4380-b642-f163b11e54ae None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:28.030956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75ad5-23dc-4380-b642-f163b11e54ae None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:28.031199 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d75ad5-23dc-4380-b642-f163b11e54ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:28.034963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba979c-c00c-44fd-b7ad-82e24558a186 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:28.050090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d75ad5-23dc-4380-b642-f163b11e54ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:28.051589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d75ad5-23dc-4380-b642-f163b11e54ae None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-71d75ad5-23dc-4380-b642-f163b11e54ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:14:28.072246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:28.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:28.073890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:14:28.073890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:14:28.073890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:14:28.073890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:28.074086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0c2be-cb1c-4670-8ca3-544ea24eae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:28.074190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:28.074492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0c2be-cb1c-4670-8ca3-544ea24eae24 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:28.074766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0c2be-cb1c-4670-8ca3-544ea24eae24 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:28.075046 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0c2be-cb1c-4670-8ca3-544ea24eae24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:28.076308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0c2be-cb1c-4670-8ca3-544ea24eae24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:28.078115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0c2be-cb1c-4670-8ca3-544ea24eae24 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:28.079740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:28.080289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d75ad5-23dc-4380-b642-f163b11e54ae None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:28.085190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0c2be-cb1c-4670-8ca3-544ea24eae24 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:28.138608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:28.165456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:28.183856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d75ad5-23dc-4380-b642-f163b11e54ae None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:28.186386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0c2be-cb1c-4670-8ca3-544ea24eae24 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:28.217678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565b854-048d-47df-a28e-fe2f2c67c357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:28.218356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b854-048d-47df-a28e-fe2f2c67c357 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:28.218639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b854-048d-47df-a28e-fe2f2c67c357 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:28.218913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b854-048d-47df-a28e-fe2f2c67c357 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:28.219457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856381c-87d7-42e1-b95c-b88ae42265ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:28.219637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565b854-048d-47df-a28e-fe2f2c67c357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:28.219943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565b854-048d-47df-a28e-fe2f2c67c357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:28.220163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856381c-87d7-42e1-b95c-b88ae42265ca None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:28.220455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856381c-87d7-42e1-b95c-b88ae42265ca None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:28.220740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856381c-87d7-42e1-b95c-b88ae42265ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:28.221374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565b854-048d-47df-a28e-fe2f2c67c357 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:28.221585 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856381c-87d7-42e1-b95c-b88ae42265ca None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.domain.id=default, user.id=ad4863301fe44ec5b40adc370b3a51b3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:28.221902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856381c-87d7-42e1-b95c-b88ae42265ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:28.223368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856381c-87d7-42e1-b95c-b88ae42265ca None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:28.230503 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 11/20] 10.222.0.39 () {56 vars in 1322 bytes} [Sat Jun 4 18:14:28 2022] GET /identity/v3/role_assignments?user.id=ad4863301fe44ec5b40adc370b3a51b3&scope.domain.id=default&role.id=9f557e97d94b4b499a6765419452e1ef => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:28.239177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 10/21] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:30.912480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9b41-c0b6-4480-81db-5bef673ca406 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:30.912993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9b41-c0b6-4480-81db-5bef673ca406 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:30.913064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc9b41-c0b6-4480-81db-5bef673ca406 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:30.914679 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 12/22] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:30.929957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f2dfe-6afd-4a58-b935-4528015d94da None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:30.930482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f2dfe-6afd-4a58-b935-4528015d94da None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:30.930555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f2dfe-6afd-4a58-b935-4528015d94da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:30.957041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b42f2dfe-6afd-4a58-b935-4528015d94da None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:30.958259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b42f2dfe-6afd-4a58-b935-4528015d94da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:31.053390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:14:31.070146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dc262-be31-4f6a-95b4-a0e796b0118d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:31.070459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dc262-be31-4f6a-95b4-a0e796b0118d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:31.070721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dc262-be31-4f6a-95b4-a0e796b0118d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:31.076370 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:31.081980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885a58-c9e9-4395-a562-4fabbecfd69e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:31.082279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885a58-c9e9-4395-a562-4fabbecfd69e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:31.082564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885a58-c9e9-4395-a562-4fabbecfd69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:31.088450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dc262-be31-4f6a-95b4-a0e796b0118d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:31.120799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f6885a58-c9e9-4395-a562-4fabbecfd69e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:31.122011 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f6885a58-c9e9-4395-a562-4fabbecfd69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:31.238450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:31.288405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 12/25] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:14:31.290321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab67d0-695c-45ee-a135-ac8fd7dd4c00 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:31.290801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab67d0-695c-45ee-a135-ac8fd7dd4c00 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:31.291789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab67d0-695c-45ee-a135-ac8fd7dd4c00 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:31.293279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 13/26] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:31.299435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998d8ff-d748-4b1b-945a-f8141dd001b7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:31.299984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998d8ff-d748-4b1b-945a-f8141dd001b7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:31.300566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998d8ff-d748-4b1b-945a-f8141dd001b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:31.320685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0998d8ff-d748-4b1b-945a-f8141dd001b7 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:31.322201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0998d8ff-d748-4b1b-945a-f8141dd001b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:31.339091 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dc262-be31-4f6a-95b4-a0e796b0118d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:31.389307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a97083-f4aa-4e37-86d4-2b8f4d6d2156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:31.390137 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a97083-f4aa-4e37-86d4-2b8f4d6d2156 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:31.390426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a97083-f4aa-4e37-86d4-2b8f4d6d2156 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:31.390704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a97083-f4aa-4e37-86d4-2b8f4d6d2156 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:31.410795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a97083-f4aa-4e37-86d4-2b8f4d6d2156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-89a97083-f4aa-4e37-86d4-2b8f4d6d2156 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:31.419008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:31.419819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 14/27] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:14:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:14:31.421073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a97083-f4aa-4e37-86d4-2b8f4d6d2156 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:31.452403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:31.457480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 14/28] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:14:31.458387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998d8ff-d748-4b1b-945a-f8141dd001b7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:31.556129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a97083-f4aa-4e37-86d4-2b8f4d6d2156 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:31.593199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da038cbf-f731-4467-8c90-0814b86af1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:31.594186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da038cbf-f731-4467-8c90-0814b86af1d0 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:31.594609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da038cbf-f731-4467-8c90-0814b86af1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:31.595024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da038cbf-f731-4467-8c90-0814b86af1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:31.595929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da038cbf-f731-4467-8c90-0814b86af1d0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:31.597547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da038cbf-f731-4467-8c90-0814b86af1d0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:31.639030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998d8ff-d748-4b1b-945a-f8141dd001b7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:31.650411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:31.697788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a2d1d-7d2b-430c-90ff-863ba0919102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:31.698490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a2d1d-7d2b-430c-90ff-863ba0919102 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:31.698839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a2d1d-7d2b-430c-90ff-863ba0919102 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:31.699120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a2d1d-7d2b-430c-90ff-863ba0919102 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:31.699957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a2d1d-7d2b-430c-90ff-863ba0919102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:31.700310 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a2d1d-7d2b-430c-90ff-863ba0919102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:31.702074 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a2d1d-7d2b-430c-90ff-863ba0919102 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:31.722228 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 15/29] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:31.723326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a2d1d-7d2b-430c-90ff-863ba0919102 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:31.754206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 15/30] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Jun 4 18:14:31 2022] POST /identity/v3/roles => generated 219 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:14:31.760033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8099644-d14a-4c8c-b7e9-82e1d4b21aae None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:31.760755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8099644-d14a-4c8c-b7e9-82e1d4b21aae None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:31.761182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8099644-d14a-4c8c-b7e9-82e1d4b21aae None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:31.768899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 16/31] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:31 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:31.770026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8099644-d14a-4c8c-b7e9-82e1d4b21aae None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:31.850246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a2d1d-7d2b-430c-90ff-863ba0919102 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:31.891836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b099c-5c95-4a08-b76d-e06626e2801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:31.892975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b099c-5c95-4a08-b76d-e06626e2801d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:31.893444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b099c-5c95-4a08-b76d-e06626e2801d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:31.893871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b099c-5c95-4a08-b76d-e06626e2801d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:31.907377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b099c-5c95-4a08-b76d-e06626e2801d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:31.909403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b099c-5c95-4a08-b76d-e06626e2801d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f49b099c-5c95-4a08-b76d-e06626e2801d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:14:31.930815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:31.932356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:31.933351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:14:31.933351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:14:31.933351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:14:31.933351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:31.935014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:31.936663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd73f-f1bd-4ee6-9bed-09b4ebee7f9f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:31.937236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd73f-f1bd-4ee6-9bed-09b4ebee7f9f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:31.937688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bd73f-f1bd-4ee6-9bed-09b4ebee7f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:31.949325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:31.959522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a23bd73f-f1bd-4ee6-9bed-09b4ebee7f9f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:31.961032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a23bd73f-f1bd-4ee6-9bed-09b4ebee7f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:31.979645 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:32.028510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8099644-d14a-4c8c-b7e9-82e1d4b21aae None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:32.044668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 17/33] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:32.045711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bd73f-f1bd-4ee6-9bed-09b4ebee7f9f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:32.072957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f837b-f8b1-4099-aac9-2f7fe8eebb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:32.074207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f837b-f8b1-4099-aac9-2f7fe8eebb65 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.074720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f837b-f8b1-4099-aac9-2f7fe8eebb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.075214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f837b-f8b1-4099-aac9-2f7fe8eebb65 None admin] PATH_INFO: `/v3/users/ad4863301fe44ec5b40adc370b3a51b3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.077004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f837b-f8b1-4099-aac9-2f7fe8eebb65 None admin] RBAC: Authorizing `identity:get_user(user_id=ad4863301fe44ec5b40adc370b3a51b3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:32.078856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f837b-f8b1-4099-aac9-2f7fe8eebb65 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:32.081045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 17/34] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:31 2022] GET /identity/v3/users/ad4863301fe44ec5b40adc370b3a51b3 => generated 247 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:32.086130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f837b-f8b1-4099-aac9-2f7fe8eebb65 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:32.183902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bd73f-f1bd-4ee6-9bed-09b4ebee7f9f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:32.190674 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f837b-f8b1-4099-aac9-2f7fe8eebb65 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:32.220672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:32.223078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a93ec-5f62-4a40-bb14-b388f6dc6412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:32.223774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a93ec-5f62-4a40-bb14-b388f6dc6412 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.224241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a93ec-5f62-4a40-bb14-b388f6dc6412 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.224521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a93ec-5f62-4a40-bb14-b388f6dc6412 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.225434 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a93ec-5f62-4a40-bb14-b388f6dc6412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:32.225758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a93ec-5f62-4a40-bb14-b388f6dc6412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:32.226583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd42429-2519-42b1-b191-9d203abcca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:32.227428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42429-2519-42b1-b191-9d203abcca71 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.227904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42429-2519-42b1-b191-9d203abcca71 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.228024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a93ec-5f62-4a40-bb14-b388f6dc6412 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:32.228371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd42429-2519-42b1-b191-9d203abcca71 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.229253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd42429-2519-42b1-b191-9d203abcca71 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:32.230830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd42429-2519-42b1-b191-9d203abcca71 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:32.247030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 18/35] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Jun 4 18:14:32 2022] POST /identity/v3/roles => generated 225 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:14:32.248592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd42429-2519-42b1-b191-9d203abcca71 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:32.250346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 18/36] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:32.256072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a93ec-5f62-4a40-bb14-b388f6dc6412 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:32.270677 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:32.376195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a93ec-5f62-4a40-bb14-b388f6dc6412 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:32.396710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd42429-2519-42b1-b191-9d203abcca71 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:32.414831 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa998f88-3221-4bfb-bd55-6d956d2a9fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:32.415926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998f88-3221-4bfb-bd55-6d956d2a9fd2 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.415926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998f88-3221-4bfb-bd55-6d956d2a9fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.416785 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998f88-3221-4bfb-bd55-6d956d2a9fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.417894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa998f88-3221-4bfb-bd55-6d956d2a9fd2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:32.419503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa998f88-3221-4bfb-bd55-6d956d2a9fd2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:32.442073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ffdc-f0f3-4444-960a-8e3c64b9f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:32.442941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ffdc-f0f3-4444-960a-8e3c64b9f82a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.444203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ffdc-f0f3-4444-960a-8e3c64b9f82a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.444203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ffdc-f0f3-4444-960a-8e3c64b9f82a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.445277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ffdc-f0f3-4444-960a-8e3c64b9f82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:32.447335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ffdc-f0f3-4444-960a-8e3c64b9f82a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:32.449692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 19/37] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:32.455200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3e90-06c1-4c66-a2fe-ec59bb4e0904 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.455200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3e90-06c1-4c66-a2fe-ec59bb4e0904 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.455200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3e90-06c1-4c66-a2fe-ec59bb4e0904 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.455200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 20/38] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:32.456582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3e90-06c1-4c66-a2fe-ec59bb4e0904 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:32.534216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:32.576766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:14:32 2022] POST /identity/v3/projects => generated 301 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:14:32.578702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3864296-88ba-47e3-82d9-7a75e77cb8fa None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.579147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3864296-88ba-47e3-82d9-7a75e77cb8fa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.579594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3864296-88ba-47e3-82d9-7a75e77cb8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.586606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3e90-06c1-4c66-a2fe-ec59bb4e0904 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:32.602960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a3864296-88ba-47e3-82d9-7a75e77cb8fa None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:32.605112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a3864296-88ba-47e3-82d9-7a75e77cb8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:32.625267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bc03a-8197-4bb1-a66a-b28726f4041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:32.626183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bc03a-8197-4bb1-a66a-b28726f4041d None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.626465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bc03a-8197-4bb1-a66a-b28726f4041d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.626862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bc03a-8197-4bb1-a66a-b28726f4041d None admin] PATH_INFO: `/v3/domains/default/users/ad4863301fe44ec5b40adc370b3a51b3/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.630277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bc03a-8197-4bb1-a66a-b28726f4041d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ad4863301fe44ec5b40adc370b3a51b3, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:32.632045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bc03a-8197-4bb1-a66a-b28726f4041d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:32.652625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 21/40] 10.222.0.39 () {58 vars in 1361 bytes} [Sat Jun 4 18:14:32 2022] PUT /identity/v3/domains/default/users/ad4863301fe44ec5b40adc370b3a51b3/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:14:32.683333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6309c-8d32-4ace-9188-b3327b7ccede None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.683646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6309c-8d32-4ace-9188-b3327b7ccede None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.683903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6309c-8d32-4ace-9188-b3327b7ccede None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.686030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 22/41] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:32.688215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:32.700223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a33e3-3ba6-4872-914b-a69d9b2df05e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.700428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a33e3-3ba6-4872-914b-a69d9b2df05e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.700723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a33e3-3ba6-4872-914b-a69d9b2df05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.703786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 20/42] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:32.724288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6e2a33e3-3ba6-4872-914b-a69d9b2df05e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:32.726349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6e2a33e3-3ba6-4872-914b-a69d9b2df05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:32.735850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3864296-88ba-47e3-82d9-7a75e77cb8fa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:32.822898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 23/43] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:32.848708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a33e3-3ba6-4872-914b-a69d9b2df05e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:32.871116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3864296-88ba-47e3-82d9-7a75e77cb8fa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:32.912599 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990a22a-ae49-4bcf-94e9-251c4ec044ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:32.913301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990a22a-ae49-4bcf-94e9-251c4ec044ec None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:32.913589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990a22a-ae49-4bcf-94e9-251c4ec044ec None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:32.913864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990a22a-ae49-4bcf-94e9-251c4ec044ec None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:32.914140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:32.914672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990a22a-ae49-4bcf-94e9-251c4ec044ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:32.916754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990a22a-ae49-4bcf-94e9-251c4ec044ec None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:32.937692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 21/44] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Jun 4 18:14:32 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:14:32.979146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a33e3-3ba6-4872-914b-a69d9b2df05e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:33.020891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d1524-fd31-4f0c-aa98-3a7a41a5d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:33.021791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d1524-fd31-4f0c-aa98-3a7a41a5d84a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:33.022086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d1524-fd31-4f0c-aa98-3a7a41a5d84a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:33.022419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d1524-fd31-4f0c-aa98-3a7a41a5d84a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:33.023673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d1524-fd31-4f0c-aa98-3a7a41a5d84a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:33.025221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d1524-fd31-4f0c-aa98-3a7a41a5d84a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:33.026953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 24/45] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:33.033126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990a22a-ae49-4bcf-94e9-251c4ec044ec None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:33.092886 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:33.149730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990a22a-ae49-4bcf-94e9-251c4ec044ec None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:33.186134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926f986-e261-4182-ae7b-84b6b6e0e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:33.186880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926f986-e261-4182-ae7b-84b6b6e0e58b None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:33.187193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926f986-e261-4182-ae7b-84b6b6e0e58b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:33.187467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926f986-e261-4182-ae7b-84b6b6e0e58b None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:33.188255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926f986-e261-4182-ae7b-84b6b6e0e58b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:33.189759 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926f986-e261-4182-ae7b-84b6b6e0e58b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:33.220519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 22/46] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:14:33 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:14:34.937074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048de6-2937-466e-8410-b16fc71e48f8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:34.937612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048de6-2937-466e-8410-b16fc71e48f8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:34.937612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048de6-2937-466e-8410-b16fc71e48f8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:34.939059 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 25/47] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:34.944490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8056666-7f8a-4e4b-9a9b-84cb3dcd7820 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:34.944910 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8056666-7f8a-4e4b-9a9b-84cb3dcd7820 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:34.945096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8056666-7f8a-4e4b-9a9b-84cb3dcd7820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:34.962782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e8056666-7f8a-4e4b-9a9b-84cb3dcd7820 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:34.964041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e8056666-7f8a-4e4b-9a9b-84cb3dcd7820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:35.034247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 23/48] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:35.057660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048de6-2937-466e-8410-b16fc71e48f8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:35.167158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048de6-2937-466e-8410-b16fc71e48f8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:35.187597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:35.207577 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dd754-ca6c-4ac8-99de-82fd0ef51d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:35.208424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd754-ca6c-4ac8-99de-82fd0ef51d56 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:35.208744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd754-ca6c-4ac8-99de-82fd0ef51d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:35.208981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dd754-ca6c-4ac8-99de-82fd0ef51d56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:35.220172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dd754-ca6c-4ac8-99de-82fd0ef51d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-601dd754-ca6c-4ac8-99de-82fd0ef51d56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:35.227740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:35.228721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:14:35.229771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 26/49] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:14:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:35.234916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8056666-7f8a-4e4b-9a9b-84cb3dcd7820 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:35.269288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:35.340165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8056666-7f8a-4e4b-9a9b-84cb3dcd7820 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:35.377648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064debf-076a-43ae-a05f-c3fc137a0155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:35.378323 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064debf-076a-43ae-a05f-c3fc137a0155 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:35.378607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064debf-076a-43ae-a05f-c3fc137a0155 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:35.378883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064debf-076a-43ae-a05f-c3fc137a0155 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:35.379638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064debf-076a-43ae-a05f-c3fc137a0155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:35.379950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064debf-076a-43ae-a05f-c3fc137a0155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:35.381369 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064debf-076a-43ae-a05f-c3fc137a0155 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:35.390819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 24/50] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:35.396716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dd754-ca6c-4ac8-99de-82fd0ef51d56 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:35.445702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81f43-d93d-45a7-8167-d17a177083c2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:35.445878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81f43-d93d-45a7-8167-d17a177083c2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:35.446177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81f43-d93d-45a7-8167-d17a177083c2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:35.447565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 25/51] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:35.452962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78b9b-230e-4e96-be98-b52a29413fa3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:35.453243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78b9b-230e-4e96-be98-b52a29413fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:35.453528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf78b9b-230e-4e96-be98-b52a29413fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:35.470260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fbf78b9b-230e-4e96-be98-b52a29413fa3 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:35.474467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fbf78b9b-230e-4e96-be98-b52a29413fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:35.499125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dd754-ca6c-4ac8-99de-82fd0ef51d56 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:35.532209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113485a-b8c1-4d56-9438-99beaadc187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:35.533098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113485a-b8c1-4d56-9438-99beaadc187a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:35.533390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113485a-b8c1-4d56-9438-99beaadc187a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:35.533663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113485a-b8c1-4d56-9438-99beaadc187a None admin] PATH_INFO: `/v3/users/ad4863301fe44ec5b40adc370b3a51b3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:35.534900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113485a-b8c1-4d56-9438-99beaadc187a None admin] RBAC: Authorizing `identity:get_user(user_id=ad4863301fe44ec5b40adc370b3a51b3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:35.536417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113485a-b8c1-4d56-9438-99beaadc187a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:35.538043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 27/52] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:35 2022] GET /identity/v3/users/ad4863301fe44ec5b40adc370b3a51b3 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:35.538683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 26/53] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:35.543833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113485a-b8c1-4d56-9438-99beaadc187a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:35.562730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf78b9b-230e-4e96-be98-b52a29413fa3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:35.589040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:35.590004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:35.649176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113485a-b8c1-4d56-9438-99beaadc187a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:35.665245 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf78b9b-230e-4e96-be98-b52a29413fa3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:35.682286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570b948-cf1d-42b2-baa7-7f1edd918f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:35.683096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b948-cf1d-42b2-baa7-7f1edd918f8d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:35.683385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b948-cf1d-42b2-baa7-7f1edd918f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:35.683666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b948-cf1d-42b2-baa7-7f1edd918f8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:35.684892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570b948-cf1d-42b2-baa7-7f1edd918f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:35.686483 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570b948-cf1d-42b2-baa7-7f1edd918f8d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:35.688169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 28/54] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:35.694009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570b948-cf1d-42b2-baa7-7f1edd918f8d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:35.701607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8b387-9af2-4548-8ebe-d19591b35636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:35.702476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b387-9af2-4548-8ebe-d19591b35636 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:35.702761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b387-9af2-4548-8ebe-d19591b35636 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:35.703039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8b387-9af2-4548-8ebe-d19591b35636 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:35.704273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8b387-9af2-4548-8ebe-d19591b35636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:35.705739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8b387-9af2-4548-8ebe-d19591b35636 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:35.707348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:35.712825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8b387-9af2-4548-8ebe-d19591b35636 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:35.795876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570b948-cf1d-42b2-baa7-7f1edd918f8d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:35.807345 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:35.809829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:35.815364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8b387-9af2-4548-8ebe-d19591b35636 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:35.831369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736e8eb-d7c0-4807-b050-722858c549a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:35.832061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e8eb-d7c0-4807-b050-722858c549a8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:35.832350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e8eb-d7c0-4807-b050-722858c549a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:35.832630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736e8eb-d7c0-4807-b050-722858c549a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:35.833475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736e8eb-d7c0-4807-b050-722858c549a8 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.domain.id=default, user.id=ad4863301fe44ec5b40adc370b3a51b3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:35.833792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736e8eb-d7c0-4807-b050-722858c549a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:35.835266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736e8eb-d7c0-4807-b050-722858c549a8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:35.841328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 29/56] 10.222.0.39 () {56 vars in 1322 bytes} [Sat Jun 4 18:14:35 2022] GET /identity/v3/role_assignments?user.id=ad4863301fe44ec5b40adc370b3a51b3&scope.domain.id=default&role.id=9f557e97d94b4b499a6765419452e1ef => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:35.851229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543aefa-3c60-4716-a448-ae7278de13d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:35.851927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543aefa-3c60-4716-a448-ae7278de13d0 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:35.852247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543aefa-3c60-4716-a448-ae7278de13d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:35.852530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543aefa-3c60-4716-a448-ae7278de13d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:35.853287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543aefa-3c60-4716-a448-ae7278de13d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:35.854794 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543aefa-3c60-4716-a448-ae7278de13d0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:35.885927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 28/57] 10.222.0.39 () {60 vars in 1140 bytes} [Sat Jun 4 18:14:35 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:14:38.134151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211227-6a0a-4a54-be35-02c0e42b0b73 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:38.134697 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211227-6a0a-4a54-be35-02c0e42b0b73 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:38.134697 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211227-6a0a-4a54-be35-02c0e42b0b73 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:38.136138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 30/58] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:38.142647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001305e-3307-4fd4-9f5f-af74ea6bb0a7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:38.143070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001305e-3307-4fd4-9f5f-af74ea6bb0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:38.143277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001305e-3307-4fd4-9f5f-af74ea6bb0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:38.172763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4001305e-3307-4fd4-9f5f-af74ea6bb0a7 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:38.174659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4001305e-3307-4fd4-9f5f-af74ea6bb0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:38.255944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 29/59] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:38.281234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d211227-6a0a-4a54-be35-02c0e42b0b73 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:38.399495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d211227-6a0a-4a54-be35-02c0e42b0b73 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:38.444929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a051a-d813-45d0-964e-154d1a749466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:38.445728 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a051a-d813-45d0-964e-154d1a749466 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:38.446017 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a051a-d813-45d0-964e-154d1a749466 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:38.446297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a051a-d813-45d0-964e-154d1a749466 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:38.447551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a051a-d813-45d0-964e-154d1a749466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:38.449077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a051a-d813-45d0-964e-154d1a749466 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:38.450730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 31/60] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:38.457693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001305e-3307-4fd4-9f5f-af74ea6bb0a7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:38.553322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:38.583233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001305e-3307-4fd4-9f5f-af74ea6bb0a7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:38.619919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997f518-7b22-48e3-a7c3-b817dbd7b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:38.620623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f518-7b22-48e3-a7c3-b817dbd7b52d None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:38.620918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f518-7b22-48e3-a7c3-b817dbd7b52d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:38.621197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f518-7b22-48e3-a7c3-b817dbd7b52d None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:38.621911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997f518-7b22-48e3-a7c3-b817dbd7b52d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:38.623377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997f518-7b22-48e3-a7c3-b817dbd7b52d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:38.654168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 30/61] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:14:38 2022] POST /identity/v3/users => generated 275 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:14:41.964435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce90f-b95b-41e7-9934-4356f3746363 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:41.965465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce90f-b95b-41e7-9934-4356f3746363 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:41.965974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbce90f-b95b-41e7-9934-4356f3746363 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:41.968271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 32/62] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:41.973614 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b87fa-be5b-49fe-bd95-a8b45c649c9e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:41.974477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b87fa-be5b-49fe-bd95-a8b45c649c9e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:41.974953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b87fa-be5b-49fe-bd95-a8b45c649c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:41.997037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2c2b87fa-be5b-49fe-bd95-a8b45c649c9e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:41.998642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2c2b87fa-be5b-49fe-bd95-a8b45c649c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:42.094173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 31/63] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:42.113237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cda0f-05fd-4746-aecf-5e202460a8a0 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.113832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cda0f-05fd-4746-aecf-5e202460a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.114297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cda0f-05fd-4746-aecf-5e202460a8a0 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.115869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 33/64] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:42.121239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd483dc-f3dc-45a9-90c7-40c28d6369b0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.121538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd483dc-f3dc-45a9-90c7-40c28d6369b0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.121828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd483dc-f3dc-45a9-90c7-40c28d6369b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.126442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cda0f-05fd-4746-aecf-5e202460a8a0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:42.149665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0fd483dc-f3dc-45a9-90c7-40c28d6369b0 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:42.149665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0fd483dc-f3dc-45a9-90c7-40c28d6369b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:42.220489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:42.282148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:42.300313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cda0f-05fd-4746-aecf-5e202460a8a0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:42.310780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 32/65] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:42.338654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd483dc-f3dc-45a9-90c7-40c28d6369b0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:42.357714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8fc8b-e57b-459d-8958-35e8b882ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:42.359351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8fc8b-e57b-459d-8958-35e8b882ba4d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.359642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8fc8b-e57b-459d-8958-35e8b882ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.359925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8fc8b-e57b-459d-8958-35e8b882ba4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.384685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8fc8b-e57b-459d-8958-35e8b882ba4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-54e8fc8b-e57b-459d-8958-35e8b882ba4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:42.392689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:42.393540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:42.394262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:14:42.396304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 34/66] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:14:42.410134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8fc8b-e57b-459d-8958-35e8b882ba4d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:42.482180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd483dc-f3dc-45a9-90c7-40c28d6369b0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:42.520579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc87c49-7b42-4db1-815f-e305d0c23bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:42.521768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc87c49-7b42-4db1-815f-e305d0c23bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.522302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc87c49-7b42-4db1-815f-e305d0c23bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.522877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc87c49-7b42-4db1-815f-e305d0c23bb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.536300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc87c49-7b42-4db1-815f-e305d0c23bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:42.544250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8fc8b-e57b-459d-8958-35e8b882ba4d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-dfc87c49-7b42-4db1-815f-e305d0c23bb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:42.546786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:42.547597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:42.548370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:42.550715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 33/67] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:14:42.555780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:42.558149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468969ad-01f6-4e97-ae90-51214e599fcd None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.558640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468969ad-01f6-4e97-ae90-51214e599fcd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.559127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468969ad-01f6-4e97-ae90-51214e599fcd None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.560769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 34/68] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:42.562751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468969ad-01f6-4e97-ae90-51214e599fcd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:42.582965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5ed7d-5115-44c4-a6a3-19bdb1c17150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:42.583659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5ed7d-5115-44c4-a6a3-19bdb1c17150 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.583938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5ed7d-5115-44c4-a6a3-19bdb1c17150 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.584250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5ed7d-5115-44c4-a6a3-19bdb1c17150 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.585022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5ed7d-5115-44c4-a6a3-19bdb1c17150 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:42.585336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5ed7d-5115-44c4-a6a3-19bdb1c17150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:42.586750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5ed7d-5115-44c4-a6a3-19bdb1c17150 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:42.596678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 35/69] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:14:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:42.597918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46acdb-a9fa-472a-83f4-a9326822bd1e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.598215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46acdb-a9fa-472a-83f4-a9326822bd1e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.598498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46acdb-a9fa-472a-83f4-a9326822bd1e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.600062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 36/70] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:42.601114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215a64-fb5c-4ff7-b77f-8ee773fce625 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.601401 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215a64-fb5c-4ff7-b77f-8ee773fce625 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.601684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215a64-fb5c-4ff7-b77f-8ee773fce625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.621625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-28215a64-fb5c-4ff7-b77f-8ee773fce625 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:42.623447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-28215a64-fb5c-4ff7-b77f-8ee773fce625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:42.636039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:42.687006 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468969ad-01f6-4e97-ae90-51214e599fcd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:42.698754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 37/71] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:42.699609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215a64-fb5c-4ff7-b77f-8ee773fce625 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:42.728820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77be652-1603-470e-b839-d14d3c9b62f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:42.729509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77be652-1603-470e-b839-d14d3c9b62f4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.729807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77be652-1603-470e-b839-d14d3c9b62f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.730086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77be652-1603-470e-b839-d14d3c9b62f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.730857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77be652-1603-470e-b839-d14d3c9b62f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:42.731170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77be652-1603-470e-b839-d14d3c9b62f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:42.732672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77be652-1603-470e-b839-d14d3c9b62f4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:42.745912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 35/72] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:42.745912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbefca-32ee-43e6-a285-9ff9e4e01972 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.745912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbefca-32ee-43e6-a285-9ff9e4e01972 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.745912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbefca-32ee-43e6-a285-9ff9e4e01972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.759502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5dcbefca-32ee-43e6-a285-9ff9e4e01972 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:42.760819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5dcbefca-32ee-43e6-a285-9ff9e4e01972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:42.806537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:42.810405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215a64-fb5c-4ff7-b77f-8ee773fce625 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:42.832871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 36/73] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:42.836207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbefca-32ee-43e6-a285-9ff9e4e01972 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:42.849618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85761211-5cd2-478b-99d0-268fb2e4bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:42.850520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85761211-5cd2-478b-99d0-268fb2e4bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.850807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85761211-5cd2-478b-99d0-268fb2e4bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.851089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85761211-5cd2-478b-99d0-268fb2e4bbf2 None admin] PATH_INFO: `/v3/users/dbabdd5b42334ed08a87a2bea3cbaace` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:42.866135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85761211-5cd2-478b-99d0-268fb2e4bbf2 None admin] RBAC: Authorizing `identity:get_user(user_id=dbabdd5b42334ed08a87a2bea3cbaace)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:42.867693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85761211-5cd2-478b-99d0-268fb2e4bbf2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:42.869485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 38/74] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:42 2022] GET /identity/v3/users/dbabdd5b42334ed08a87a2bea3cbaace => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:42.870457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85761211-5cd2-478b-99d0-268fb2e4bbf2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:42.897805 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:42.958564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbefca-32ee-43e6-a285-9ff9e4e01972 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:42.983677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85761211-5cd2-478b-99d0-268fb2e4bbf2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:42.993168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa328f-039f-4d9f-a360-cf3a1dac0ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:42.994168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa328f-039f-4d9f-a360-cf3a1dac0ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:42.994339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa328f-039f-4d9f-a360-cf3a1dac0ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:42.994551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa328f-039f-4d9f-a360-cf3a1dac0ca6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.005061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa328f-039f-4d9f-a360-cf3a1dac0ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-60aa328f-039f-4d9f-a360-cf3a1dac0ca6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:43.013077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:43.013893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:43.015164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:14:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:43.015782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa328f-039f-4d9f-a360-cf3a1dac0ca6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.023347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9915c-c573-4b8c-8048-6f8f21fbc0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:43.024274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9915c-c573-4b8c-8048-6f8f21fbc0eb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.024556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9915c-c573-4b8c-8048-6f8f21fbc0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.024828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9915c-c573-4b8c-8048-6f8f21fbc0eb None admin] PATH_INFO: `/v3/users/ad4863301fe44ec5b40adc370b3a51b3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.026041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9915c-c573-4b8c-8048-6f8f21fbc0eb None admin] RBAC: Authorizing `identity:get_user(user_id=ad4863301fe44ec5b40adc370b3a51b3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:43.027525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9915c-c573-4b8c-8048-6f8f21fbc0eb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:43.029162 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 39/76] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:42 2022] GET /identity/v3/users/ad4863301fe44ec5b40adc370b3a51b3 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:43.029952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9915c-c573-4b8c-8048-6f8f21fbc0eb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.058967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:43.114756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa328f-039f-4d9f-a360-cf3a1dac0ca6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:43.117003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:43.133668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9915c-c573-4b8c-8048-6f8f21fbc0eb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:43.149013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250930e-0e79-4e4d-b870-5b94d438af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:43.149818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250930e-0e79-4e4d-b870-5b94d438af4c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.150099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250930e-0e79-4e4d-b870-5b94d438af4c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.150378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250930e-0e79-4e4d-b870-5b94d438af4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.160414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250930e-0e79-4e4d-b870-5b94d438af4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:43.166920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14199c4-09d7-4566-be7b-0684640a3a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:43.167578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14199c4-09d7-4566-be7b-0684640a3a8f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.167862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14199c4-09d7-4566-be7b-0684640a3a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.168177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14199c4-09d7-4566-be7b-0684640a3a8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0250930e-0e79-4e4d-b870-5b94d438af4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:43.168390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:43.169355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:43.170275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 38/77] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:43.171349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084511bc-81bf-46d2-a73c-04faf7760014 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.171349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084511bc-81bf-46d2-a73c-04faf7760014 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.171349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084511bc-81bf-46d2-a73c-04faf7760014 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.172749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 39/78] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:43.177355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084511bc-81bf-46d2-a73c-04faf7760014 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.241723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14199c4-09d7-4566-be7b-0684640a3a8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:43.243133 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14199c4-09d7-4566-be7b-0684640a3a8f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:43.267658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:43.278834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084511bc-81bf-46d2-a73c-04faf7760014 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:43.315277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffcc6-3e4f-4adb-ae11-148ee819df09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:43.315958 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffcc6-3e4f-4adb-ae11-148ee819df09 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.316266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffcc6-3e4f-4adb-ae11-148ee819df09 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.316529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ffcc6-3e4f-4adb-ae11-148ee819df09 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.317294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ffcc6-3e4f-4adb-ae11-148ee819df09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:43.317601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ffcc6-3e4f-4adb-ae11-148ee819df09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:43.319015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ffcc6-3e4f-4adb-ae11-148ee819df09 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:43.327227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 40/79] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:43.328048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffcc6-3e4f-4adb-ae11-148ee819df09 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.348968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 40/80] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:14:43.349889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14199c4-09d7-4566-be7b-0684640a3a8f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.355695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:43.428984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ffcc6-3e4f-4adb-ae11-148ee819df09 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:43.448860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14199c4-09d7-4566-be7b-0684640a3a8f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:43.461175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c40fb0-7152-4196-beaa-d5cc8ae06dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:43.461824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c40fb0-7152-4196-beaa-d5cc8ae06dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.462105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c40fb0-7152-4196-beaa-d5cc8ae06dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.462378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c40fb0-7152-4196-beaa-d5cc8ae06dc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.472132 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:43.483612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55bb95-bfff-48c2-9878-045b509d4fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:43.484298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55bb95-bfff-48c2-9878-045b509d4fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.484620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55bb95-bfff-48c2-9878-045b509d4fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.484891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55bb95-bfff-48c2-9878-045b509d4fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.485652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55bb95-bfff-48c2-9878-045b509d4fb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:43.485964 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55bb95-bfff-48c2-9878-045b509d4fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:43.487451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55bb95-bfff-48c2-9878-045b509d4fb1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:43.495440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 41/81] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:43.496590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19c511-fbf3-4086-ad4e-9ca233610790 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.496881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19c511-fbf3-4086-ad4e-9ca233610790 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.497162 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19c511-fbf3-4086-ad4e-9ca233610790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.512705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9d19c511-fbf3-4086-ad4e-9ca233610790 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:43.513955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9d19c511-fbf3-4086-ad4e-9ca233610790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:43.534163 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c40fb0-7152-4196-beaa-d5cc8ae06dc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:43.535630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c40fb0-7152-4196-beaa-d5cc8ae06dc5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:43.562660 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:43.578009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 42/82] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:43.578836 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19c511-fbf3-4086-ad4e-9ca233610790 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.634266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 41/83] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:14:43.635165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c40fb0-7152-4196-beaa-d5cc8ae06dc5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.691906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19c511-fbf3-4086-ad4e-9ca233610790 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:43.709083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:43.727266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252e45c-c971-4616-a8e5-afdd7b814208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:43.728273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e45c-c971-4616-a8e5-afdd7b814208 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.728556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e45c-c971-4616-a8e5-afdd7b814208 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.728832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252e45c-c971-4616-a8e5-afdd7b814208 None admin] PATH_INFO: `/v3/users/dbabdd5b42334ed08a87a2bea3cbaace` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.730048 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252e45c-c971-4616-a8e5-afdd7b814208 None admin] RBAC: Authorizing `identity:get_user(user_id=dbabdd5b42334ed08a87a2bea3cbaace)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:43.730494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c40fb0-7152-4196-beaa-d5cc8ae06dc5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:43.731527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252e45c-c971-4616-a8e5-afdd7b814208 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:43.733683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 43/84] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/users/dbabdd5b42334ed08a87a2bea3cbaace => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:43.734421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252e45c-c971-4616-a8e5-afdd7b814208 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.757435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:43.767071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908693f2-a39c-47b1-92ff-b81ad9c6a51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:43.767953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908693f2-a39c-47b1-92ff-b81ad9c6a51e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.768259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908693f2-a39c-47b1-92ff-b81ad9c6a51e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.768516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908693f2-a39c-47b1-92ff-b81ad9c6a51e None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.769687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908693f2-a39c-47b1-92ff-b81ad9c6a51e None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:43.771185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908693f2-a39c-47b1-92ff-b81ad9c6a51e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:43.772907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 42/85] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:43.773660 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908693f2-a39c-47b1-92ff-b81ad9c6a51e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.832946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252e45c-c971-4616-a8e5-afdd7b814208 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:43.865813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92160157-62d7-4021-90d1-630b041badd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:43.866692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92160157-62d7-4021-90d1-630b041badd8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.866975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92160157-62d7-4021-90d1-630b041badd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.867249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92160157-62d7-4021-90d1-630b041badd8 None admin] PATH_INFO: `/v3/users/dbabdd5b42334ed08a87a2bea3cbaace` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.868489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92160157-62d7-4021-90d1-630b041badd8 None admin] RBAC: Authorizing `identity:get_user(user_id=dbabdd5b42334ed08a87a2bea3cbaace)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:43.869959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92160157-62d7-4021-90d1-630b041badd8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:43.871574 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 44/86] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/users/dbabdd5b42334ed08a87a2bea3cbaace => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:43.873267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908693f2-a39c-47b1-92ff-b81ad9c6a51e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:43.876872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92160157-62d7-4021-90d1-630b041badd8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.906750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe1291-c694-4f39-ba05-bafc8471b0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:43.907552 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe1291-c694-4f39-ba05-bafc8471b0cc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:43.907839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe1291-c694-4f39-ba05-bafc8471b0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:43.908140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe1291-c694-4f39-ba05-bafc8471b0cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:43.909307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe1291-c694-4f39-ba05-bafc8471b0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:43.910831 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe1291-c694-4f39-ba05-bafc8471b0cc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:43.912450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 43/87] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:43.913199 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe1291-c694-4f39-ba05-bafc8471b0cc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:43.929316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:43.978001 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92160157-62d7-4021-90d1-630b041badd8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:43.978739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:44.013927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2274581-42ee-4d2b-b427-46f3e2d285c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:44.015159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2274581-42ee-4d2b-b427-46f3e2d285c4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:44.015457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2274581-42ee-4d2b-b427-46f3e2d285c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:44.015712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2274581-42ee-4d2b-b427-46f3e2d285c4 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:44.017028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2274581-42ee-4d2b-b427-46f3e2d285c4 None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:44.018507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2274581-42ee-4d2b-b427-46f3e2d285c4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:44.019960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe1291-c694-4f39-ba05-bafc8471b0cc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:44.020385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 45/88] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:44.021004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2274581-42ee-4d2b-b427-46f3e2d285c4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:44.059421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c3cb-dbc3-4e39-8ece-fcb234c3c9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:44.060114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c3cb-dbc3-4e39-8ece-fcb234c3c9eb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:44.060403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c3cb-dbc3-4e39-8ece-fcb234c3c9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:44.060686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965c3cb-dbc3-4e39-8ece-fcb234c3c9eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:44.119305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2274581-42ee-4d2b-b427-46f3e2d285c4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:44.127726 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c3cb-dbc3-4e39-8ece-fcb234c3c9eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:44.129247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965c3cb-dbc3-4e39-8ece-fcb234c3c9eb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:44.140126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:44.155961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242abf-3b2e-4149-8e78-c5413064083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:44.156650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242abf-3b2e-4149-8e78-c5413064083b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:44.156933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242abf-3b2e-4149-8e78-c5413064083b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:44.157219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242abf-3b2e-4149-8e78-c5413064083b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:44.158068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da242abf-3b2e-4149-8e78-c5413064083b None admin] RBAC: Adding query filter params (role.id=e0e319e010e342d184a4b77ac79ecf84, scope.project.id=519eba4a80c44012af4aed921a30d31b, user.id=dbabdd5b42334ed08a87a2bea3cbaace) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:44.158384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da242abf-3b2e-4149-8e78-c5413064083b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:44.159833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da242abf-3b2e-4149-8e78-c5413064083b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:44.165478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 46/89] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:44 2022] GET /identity/v3/role_assignments?user.id=dbabdd5b42334ed08a87a2bea3cbaace&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:44.166269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242abf-3b2e-4149-8e78-c5413064083b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:44.208155 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:44.254925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 44/90] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:14:44.256207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c3cb-dbc3-4e39-8ece-fcb234c3c9eb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:44.289801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242abf-3b2e-4149-8e78-c5413064083b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:44.347248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3596d1-9021-4158-b84b-27907670f359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:44.347941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3596d1-9021-4158-b84b-27907670f359 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:44.348255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3596d1-9021-4158-b84b-27907670f359 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:44.348555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3596d1-9021-4158-b84b-27907670f359 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:44.384740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965c3cb-dbc3-4e39-8ece-fcb234c3c9eb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:44.413056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:44.421701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6266fea-d4ac-434f-80e4-567411b00f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:44.422412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266fea-d4ac-434f-80e4-567411b00f3e None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:44.422684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266fea-d4ac-434f-80e4-567411b00f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:44.423026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266fea-d4ac-434f-80e4-567411b00f3e None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:44.423754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6266fea-d4ac-434f-80e4-567411b00f3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:44.425268 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6266fea-d4ac-434f-80e4-567411b00f3e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:44.430993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3596d1-9021-4158-b84b-27907670f359 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:44.432509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3596d1-9021-4158-b84b-27907670f359 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:44.446992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 45/91] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:14:44 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:14:44.454500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6266fea-d4ac-434f-80e4-567411b00f3e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:44.478217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:44.560068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 47/92] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:14:44.560877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3596d1-9021-4158-b84b-27907670f359 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:44.600555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6266fea-d4ac-434f-80e4-567411b00f3e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:44.647773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516db4b-e2f1-485e-9a63-09487bd739d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:44.649066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516db4b-e2f1-485e-9a63-09487bd739d7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:44.649737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516db4b-e2f1-485e-9a63-09487bd739d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:44.650123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516db4b-e2f1-485e-9a63-09487bd739d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:44.651457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516db4b-e2f1-485e-9a63-09487bd739d7 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=519eba4a80c44012af4aed921a30d31b, user.id=ad4863301fe44ec5b40adc370b3a51b3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:44.652467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516db4b-e2f1-485e-9a63-09487bd739d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:44.654348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516db4b-e2f1-485e-9a63-09487bd739d7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:44.655071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:44.671235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 46/93] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:44 2022] GET /identity/v3/role_assignments?user.id=ad4863301fe44ec5b40adc370b3a51b3&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=9f557e97d94b4b499a6765419452e1ef => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:44.672306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516db4b-e2f1-485e-9a63-09487bd739d7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:44.699592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3596d1-9021-4158-b84b-27907670f359 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:44.754185 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccef904-40a9-49e6-b25c-725e48cc1dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:44.755107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccef904-40a9-49e6-b25c-725e48cc1dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:44.755409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccef904-40a9-49e6-b25c-725e48cc1dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:44.755684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccef904-40a9-49e6-b25c-725e48cc1dd9 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:44.757018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccef904-40a9-49e6-b25c-725e48cc1dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:44.758776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccef904-40a9-49e6-b25c-725e48cc1dd9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:44.761196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 48/94] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:44 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:44.768377 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccef904-40a9-49e6-b25c-725e48cc1dd9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:44.792457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:44.825450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516db4b-e2f1-485e-9a63-09487bd739d7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:44.879011 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf8aec-e9d1-4eb3-a3fd-c6cef2991416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:44.880312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf8aec-e9d1-4eb3-a3fd-c6cef2991416 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:44.881332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf8aec-e9d1-4eb3-a3fd-c6cef2991416 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:44.881769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf8aec-e9d1-4eb3-a3fd-c6cef2991416 None admin] PATH_INFO: `/v3/projects/a2a01bd5a9694962a496a32af021e428` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:44.883374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf8aec-e9d1-4eb3-a3fd-c6cef2991416 None admin] RBAC: Authorizing `identity:get_project(project_id=a2a01bd5a9694962a496a32af021e428)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:44.885291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf8aec-e9d1-4eb3-a3fd-c6cef2991416 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:44.888991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 47/95] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:44 2022] GET /identity/v3/projects/a2a01bd5a9694962a496a32af021e428 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:44.898744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf8aec-e9d1-4eb3-a3fd-c6cef2991416 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:44.911961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccef904-40a9-49e6-b25c-725e48cc1dd9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:44.966008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cd03e-181a-4d9d-8742-c9dfd3d763b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:44.966720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cd03e-181a-4d9d-8742-c9dfd3d763b8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:44.967516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cd03e-181a-4d9d-8742-c9dfd3d763b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:44.967875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cd03e-181a-4d9d-8742-c9dfd3d763b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:44.968776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cd03e-181a-4d9d-8742-c9dfd3d763b8 None admin] RBAC: Adding query filter params (role.id=f75ffcd78e8b4fb8a4942efdd54e431f, scope.project.id=519eba4a80c44012af4aed921a30d31b, user.id=dbabdd5b42334ed08a87a2bea3cbaace) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:44.969102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cd03e-181a-4d9d-8742-c9dfd3d763b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:44.970895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cd03e-181a-4d9d-8742-c9dfd3d763b8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:44.979881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 49/96] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:44 2022] GET /identity/v3/role_assignments?user.id=dbabdd5b42334ed08a87a2bea3cbaace&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=f75ffcd78e8b4fb8a4942efdd54e431f => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:45.051983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf8aec-e9d1-4eb3-a3fd-c6cef2991416 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:45.097016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bc0a0-41f3-466a-8745-57d0f2a56768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:45.097625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc0a0-41f3-466a-8745-57d0f2a56768 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:45.097916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc0a0-41f3-466a-8745-57d0f2a56768 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:45.098195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc0a0-41f3-466a-8745-57d0f2a56768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:45.099059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bc0a0-41f3-466a-8745-57d0f2a56768 None admin] RBAC: Adding query filter params (role.id=e0e319e010e342d184a4b77ac79ecf84, scope.project.id=a2a01bd5a9694962a496a32af021e428, user.id=dbabdd5b42334ed08a87a2bea3cbaace) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:45.099400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bc0a0-41f3-466a-8745-57d0f2a56768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:45.100941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bc0a0-41f3-466a-8745-57d0f2a56768 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:45.107498 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 48/97] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:44 2022] GET /identity/v3/role_assignments?user.id=dbabdd5b42334ed08a87a2bea3cbaace&scope.project.id=a2a01bd5a9694962a496a32af021e428&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:47.054138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b55be-d995-4d85-b590-26dbe4f3d2fe None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:47.055157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b55be-d995-4d85-b590-26dbe4f3d2fe None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:47.055675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b55be-d995-4d85-b590-26dbe4f3d2fe None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:47.057446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 50/98] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:47.063055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e8539-f6ca-4d78-92ca-1ef9fd1f7d38 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:47.063898 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e8539-f6ca-4d78-92ca-1ef9fd1f7d38 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:47.064405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e8539-f6ca-4d78-92ca-1ef9fd1f7d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:47.093124 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-431e8539-f6ca-4d78-92ca-1ef9fd1f7d38 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:47.094869 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-431e8539-f6ca-4d78-92ca-1ef9fd1f7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:47.108399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:47.181750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 49/99] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:14:47.216409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b55be-d995-4d85-b590-26dbe4f3d2fe None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:47.242067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:47.371310 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954695-50f9-47b7-ae86-3458f94b02b1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:47.371638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954695-50f9-47b7-ae86-3458f94b02b1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:47.371870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954695-50f9-47b7-ae86-3458f94b02b1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:47.373276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 50/100] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:14:47.377372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b55be-d995-4d85-b590-26dbe4f3d2fe None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:47.385499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81a8b-8a09-4aae-9311-1530300ce1d5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:47.386066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81a8b-8a09-4aae-9311-1530300ce1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:47.386533 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81a8b-8a09-4aae-9311-1530300ce1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:47.431269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634d901-f76a-4897-bf6f-207eb323983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:47.432264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634d901-f76a-4897-bf6f-207eb323983f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:47.432552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634d901-f76a-4897-bf6f-207eb323983f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:47.432830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634d901-f76a-4897-bf6f-207eb323983f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:47.441065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1ed81a8b-8a09-4aae-9311-1530300ce1d5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:47.442536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1ed81a8b-8a09-4aae-9311-1530300ce1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:47.446645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634d901-f76a-4897-bf6f-207eb323983f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7634d901-f76a-4897-bf6f-207eb323983f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:47.455754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:47.456791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:47.457704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:14:47.459721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 51/101] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:47.470388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634d901-f76a-4897-bf6f-207eb323983f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:47.594433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 51/102] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:47.594745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:47.618680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634d901-f76a-4897-bf6f-207eb323983f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:47.646288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed81a8b-8a09-4aae-9311-1530300ce1d5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:47.703926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1790229-994c-4db1-88e0-7a02b5ad7fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:47.704951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790229-994c-4db1-88e0-7a02b5ad7fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:47.705446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790229-994c-4db1-88e0-7a02b5ad7fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:47.705901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1790229-994c-4db1-88e0-7a02b5ad7fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:47.706844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1790229-994c-4db1-88e0-7a02b5ad7fb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:47.707340 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1790229-994c-4db1-88e0-7a02b5ad7fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:47.708951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1790229-994c-4db1-88e0-7a02b5ad7fb5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:47.727928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 52/103] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:14:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:47.733344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1790229-994c-4db1-88e0-7a02b5ad7fb5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:47.790699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:47.832596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed81a8b-8a09-4aae-9311-1530300ce1d5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:47.920125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79a483-abb6-4028-ae3d-4ee52d036794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:47.921467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79a483-abb6-4028-ae3d-4ee52d036794 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:47.921959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79a483-abb6-4028-ae3d-4ee52d036794 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:47.922415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79a483-abb6-4028-ae3d-4ee52d036794 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:47.946822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79a483-abb6-4028-ae3d-4ee52d036794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9b79a483-abb6-4028-ae3d-4ee52d036794 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:47.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:47.961517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:47.962265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:47.965066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 52/104] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:14:47.971247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1790229-994c-4db1-88e0-7a02b5ad7fb5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:47.972385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79a483-abb6-4028-ae3d-4ee52d036794 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:48.045322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f8327-a8a9-44c6-8893-be44f36c5dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:48.046475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f8327-a8a9-44c6-8893-be44f36c5dda None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.046862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f8327-a8a9-44c6-8893-be44f36c5dda None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.047240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f8327-a8a9-44c6-8893-be44f36c5dda None admin] PATH_INFO: `/v3/users/dbabdd5b42334ed08a87a2bea3cbaace` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.052784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f8327-a8a9-44c6-8893-be44f36c5dda None admin] RBAC: Authorizing `identity:get_user(user_id=dbabdd5b42334ed08a87a2bea3cbaace)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:48.054402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f8327-a8a9-44c6-8893-be44f36c5dda None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:48.056367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 53/105] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:47 2022] GET /identity/v3/users/dbabdd5b42334ed08a87a2bea3cbaace => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:48.061909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f8327-a8a9-44c6-8893-be44f36c5dda None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:48.087382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:48.102387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79a483-abb6-4028-ae3d-4ee52d036794 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:48.140048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc79be-da25-454b-830e-06e68388db9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:48.141199 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc79be-da25-454b-830e-06e68388db9d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.141705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc79be-da25-454b-830e-06e68388db9d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.142207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc79be-da25-454b-830e-06e68388db9d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.143188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc79be-da25-454b-830e-06e68388db9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:48.143702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc79be-da25-454b-830e-06e68388db9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:48.145356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc79be-da25-454b-830e-06e68388db9d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:48.147310 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:48.155801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 53/106] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:48.167084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc79be-da25-454b-830e-06e68388db9d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:48.260617 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f8327-a8a9-44c6-8893-be44f36c5dda None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:48.297506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc79be-da25-454b-830e-06e68388db9d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:48.341334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14fe9f-cf6c-4bbe-8a50-fed9423062aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:48.342261 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14fe9f-cf6c-4bbe-8a50-fed9423062aa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.342615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14fe9f-cf6c-4bbe-8a50-fed9423062aa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.342898 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14fe9f-cf6c-4bbe-8a50-fed9423062aa None admin] PATH_INFO: `/v3/users/ad4863301fe44ec5b40adc370b3a51b3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.344446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c334e-ff44-4e52-86ce-9dc47e4114e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:48.345422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c334e-ff44-4e52-86ce-9dc47e4114e6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.345700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c334e-ff44-4e52-86ce-9dc47e4114e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.345975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c334e-ff44-4e52-86ce-9dc47e4114e6 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.348331 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c334e-ff44-4e52-86ce-9dc47e4114e6 None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:48.348763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14fe9f-cf6c-4bbe-8a50-fed9423062aa None admin] RBAC: Authorizing `identity:get_user(user_id=ad4863301fe44ec5b40adc370b3a51b3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:48.350326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14fe9f-cf6c-4bbe-8a50-fed9423062aa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:48.351616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c334e-ff44-4e52-86ce-9dc47e4114e6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:48.352496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 54/107] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:48 2022] GET /identity/v3/users/ad4863301fe44ec5b40adc370b3a51b3 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:48.353789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 54/108] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:48 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:48.353902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03d45a-125b-4376-904f-31ccc3b5d9b7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.354188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03d45a-125b-4376-904f-31ccc3b5d9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.354468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03d45a-125b-4376-904f-31ccc3b5d9b7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.354842 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299f4d5-8b3c-4c2f-aaab-ec34ca4eaaf7 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.355136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299f4d5-8b3c-4c2f-aaab-ec34ca4eaaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.355419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299f4d5-8b3c-4c2f-aaab-ec34ca4eaaf7 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.356030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 55/109] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:48.356856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 55/110] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:48.365277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03d45a-125b-4376-904f-31ccc3b5d9b7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:48.365975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299f4d5-8b3c-4c2f-aaab-ec34ca4eaaf7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:48.437997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:48.469837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:48.484091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03d45a-125b-4376-904f-31ccc3b5d9b7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:48.503890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299f4d5-8b3c-4c2f-aaab-ec34ca4eaaf7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:48.533421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87b623-02c7-486c-871a-006fcdc915a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:48.534768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87b623-02c7-486c-871a-006fcdc915a4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.535430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87b623-02c7-486c-871a-006fcdc915a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.536256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87b623-02c7-486c-871a-006fcdc915a4 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.538013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87b623-02c7-486c-871a-006fcdc915a4 None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:48.540034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87b623-02c7-486c-871a-006fcdc915a4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:48.541013 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e50f32-511e-4256-bc31-9f08f36bce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:48.542337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 56/111] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:48 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:48.543640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0e53c-b62a-4706-9c8b-83c720e95d1c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.544084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0e53c-b62a-4706-9c8b-83c720e95d1c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.544497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0e53c-b62a-4706-9c8b-83c720e95d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.547591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50f32-511e-4256-bc31-9f08f36bce34 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.548139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50f32-511e-4256-bc31-9f08f36bce34 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.548636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50f32-511e-4256-bc31-9f08f36bce34 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b/users/dbabdd5b42334ed08a87a2bea3cbaace/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.551061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e50f32-511e-4256-bc31-9f08f36bce34 None admin] RBAC: Authorizing `identity:create_grant(project_id=519eba4a80c44012af4aed921a30d31b, user_id=dbabdd5b42334ed08a87a2bea3cbaace, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:48.552807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e50f32-511e-4256-bc31-9f08f36bce34 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:48.563288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9db0e53c-b62a-4706-9c8b-83c720e95d1c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:48.564997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9db0e53c-b62a-4706-9c8b-83c720e95d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:48.568117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 56/112] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:14:48 2022] PUT /identity/v3/projects/519eba4a80c44012af4aed921a30d31b/users/dbabdd5b42334ed08a87a2bea3cbaace/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:14:48.570652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275002d1-4b33-4ea8-9038-ef89343a468e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.571171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275002d1-4b33-4ea8-9038-ef89343a468e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.571638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275002d1-4b33-4ea8-9038-ef89343a468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.593302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-275002d1-4b33-4ea8-9038-ef89343a468e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:48.595285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-275002d1-4b33-4ea8-9038-ef89343a468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:48.682531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 57/113] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:48.684156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275002d1-4b33-4ea8-9038-ef89343a468e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:48.697587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 57/114] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:48.699328 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e18ab-9822-4e5e-bc60-12fce5160b4a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.699773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e18ab-9822-4e5e-bc60-12fce5160b4a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.700293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e18ab-9822-4e5e-bc60-12fce5160b4a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.701993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 58/115] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:48.707562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d5622-aa71-4d3f-8feb-d8335c98f7d6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.708208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d5622-aa71-4d3f-8feb-d8335c98f7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.708681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d5622-aa71-4d3f-8feb-d8335c98f7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.738370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-923d5622-aa71-4d3f-8feb-d8335c98f7d6 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:48.739623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-923d5622-aa71-4d3f-8feb-d8335c98f7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:48.780967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:48.806905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:48.819942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 59/116] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:48.820998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d5622-aa71-4d3f-8feb-d8335c98f7d6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:48.824572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275002d1-4b33-4ea8-9038-ef89343a468e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:48.869733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6e185-27ef-48a3-b4d2-90dce34a8962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:48.870935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e185-27ef-48a3-b4d2-90dce34a8962 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.871227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e185-27ef-48a3-b4d2-90dce34a8962 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.871643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e185-27ef-48a3-b4d2-90dce34a8962 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b/users/ad4863301fe44ec5b40adc370b3a51b3/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.874296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6e185-27ef-48a3-b4d2-90dce34a8962 None admin] RBAC: Authorizing `identity:create_grant(project_id=519eba4a80c44012af4aed921a30d31b, user_id=ad4863301fe44ec5b40adc370b3a51b3, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:48.876292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6e185-27ef-48a3-b4d2-90dce34a8962 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:48.892508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 58/117] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:14:48 2022] PUT /identity/v3/projects/519eba4a80c44012af4aed921a30d31b/users/ad4863301fe44ec5b40adc370b3a51b3/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:14:48.894400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86886d4-818b-4cd5-b49a-5c72cc424440 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:48.894878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86886d4-818b-4cd5-b49a-5c72cc424440 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:48.895159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86886d4-818b-4cd5-b49a-5c72cc424440 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:48.904081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 59/118] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:48.904081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86886d4-818b-4cd5-b49a-5c72cc424440 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:48.952928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d5622-aa71-4d3f-8feb-d8335c98f7d6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.005049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c18a7-632e-405d-944b-8288ee4d09a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.006559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c18a7-632e-405d-944b-8288ee4d09a8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.007423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c18a7-632e-405d-944b-8288ee4d09a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.008036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c18a7-632e-405d-944b-8288ee4d09a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.018078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86886d4-818b-4cd5-b49a-5c72cc424440 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.024806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c18a7-632e-405d-944b-8288ee4d09a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-277c18a7-632e-405d-944b-8288ee4d09a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:49.035933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:49.037097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:49.038061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:49.040930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 60/119] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:49.042322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c18a7-632e-405d-944b-8288ee4d09a8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:49.053609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:49.068950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae730de4-ccd3-46a6-bdf2-c9659aa02732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.070183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae730de4-ccd3-46a6-bdf2-c9659aa02732 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.070309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae730de4-ccd3-46a6-bdf2-c9659aa02732 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.070718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae730de4-ccd3-46a6-bdf2-c9659aa02732 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.084765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae730de4-ccd3-46a6-bdf2-c9659aa02732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ae730de4-ccd3-46a6-bdf2-c9659aa02732 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:49.093271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:49.094320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:14:49.095070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:14:49.095625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 60/120] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:49.096994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deac939-6318-4e3e-8c92-57faaecb3701 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.097373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deac939-6318-4e3e-8c92-57faaecb3701 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.097741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deac939-6318-4e3e-8c92-57faaecb3701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.115935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:49.117314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8deac939-6318-4e3e-8c92-57faaecb3701 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:49.118920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8deac939-6318-4e3e-8c92-57faaecb3701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:49.174811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c18a7-632e-405d-944b-8288ee4d09a8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.202231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 61/121] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:49.203974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deac939-6318-4e3e-8c92-57faaecb3701 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:49.211572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b72f-efe2-49f7-b19f-069ec69aa707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.212407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b72f-efe2-49f7-b19f-069ec69aa707 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.212691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b72f-efe2-49f7-b19f-069ec69aa707 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.212966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b72f-efe2-49f7-b19f-069ec69aa707 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.214149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568b72f-efe2-49f7-b19f-069ec69aa707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:49.215744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568b72f-efe2-49f7-b19f-069ec69aa707 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:49.217615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 61/122] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:49.223162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b72f-efe2-49f7-b19f-069ec69aa707 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:49.338159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deac939-6318-4e3e-8c92-57faaecb3701 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.353298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b72f-efe2-49f7-b19f-069ec69aa707 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.357669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:49.379387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:49.383669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f160cb-bc74-4576-9186-0242ff1e750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.384405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f160cb-bc74-4576-9186-0242ff1e750d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.384735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f160cb-bc74-4576-9186-0242ff1e750d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.385014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f160cb-bc74-4576-9186-0242ff1e750d None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.386217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f160cb-bc74-4576-9186-0242ff1e750d None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:49.386532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f160cb-bc74-4576-9186-0242ff1e750d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:49.387944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f160cb-bc74-4576-9186-0242ff1e750d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:49.396522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6728b2-cc75-40da-8c42-9887d331e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.397316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 62/123] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:14:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:49.397909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6728b2-cc75-40da-8c42-9887d331e13b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.398032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f160cb-bc74-4576-9186-0242ff1e750d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:49.398508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6728b2-cc75-40da-8c42-9887d331e13b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.398984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6728b2-cc75-40da-8c42-9887d331e13b None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.399937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6728b2-cc75-40da-8c42-9887d331e13b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:49.400460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6728b2-cc75-40da-8c42-9887d331e13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:49.402330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6728b2-cc75-40da-8c42-9887d331e13b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:49.411691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 62/124] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:14:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:49.412827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6728b2-cc75-40da-8c42-9887d331e13b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:49.508429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f160cb-bc74-4576-9186-0242ff1e750d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.517556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6728b2-cc75-40da-8c42-9887d331e13b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.544225 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31f0e1-b9dc-4b90-8312-8001de70c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.545007 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31f0e1-b9dc-4b90-8312-8001de70c0ce None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.545296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31f0e1-b9dc-4b90-8312-8001de70c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.545939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31f0e1-b9dc-4b90-8312-8001de70c0ce None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.546769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31f0e1-b9dc-4b90-8312-8001de70c0ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:49.548356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31f0e1-b9dc-4b90-8312-8001de70c0ce None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:49.554642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169acf7-2151-47b9-b7a7-79c7b6e6d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.555756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169acf7-2151-47b9-b7a7-79c7b6e6d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.556286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169acf7-2151-47b9-b7a7-79c7b6e6d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.556757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169acf7-2151-47b9-b7a7-79c7b6e6d7c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.567980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169acf7-2151-47b9-b7a7-79c7b6e6d7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d169acf7-2151-47b9-b7a7-79c7b6e6d7c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:49.576999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:49.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:49.579091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 63/125] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:14:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:49.579730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169acf7-2151-47b9-b7a7-79c7b6e6d7c8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:49.582981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 63/126] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:14:49 2022] POST /identity/v3/projects => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:14:49.584237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31f0e1-b9dc-4b90-8312-8001de70c0ce None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:49.617236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:49.648150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:49.712126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31f0e1-b9dc-4b90-8312-8001de70c0ce None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.739394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169acf7-2151-47b9-b7a7-79c7b6e6d7c8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.760223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205f411-2b46-461b-ba97-14ee168db05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.761609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f411-2b46-461b-ba97-14ee168db05f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.762358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f411-2b46-461b-ba97-14ee168db05f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.762842 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205f411-2b46-461b-ba97-14ee168db05f None admin] PATH_INFO: `/v3/users/d2fbeb193f034f3f97540e35930ec344` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.779443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205f411-2b46-461b-ba97-14ee168db05f None admin] RBAC: Authorizing `identity:get_user(user_id=d2fbeb193f034f3f97540e35930ec344)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:49.781486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205f411-2b46-461b-ba97-14ee168db05f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:49.783639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 64/127] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:49 2022] GET /identity/v3/users/d2fbeb193f034f3f97540e35930ec344 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:49.784894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205f411-2b46-461b-ba97-14ee168db05f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:49.809327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe75b6-5d66-4aeb-add9-723e67fba0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.810562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe75b6-5d66-4aeb-add9-723e67fba0cf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.810856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe75b6-5d66-4aeb-add9-723e67fba0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.811224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe75b6-5d66-4aeb-add9-723e67fba0cf None admin] PATH_INFO: `/v3/users/dbabdd5b42334ed08a87a2bea3cbaace` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.813501 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe75b6-5d66-4aeb-add9-723e67fba0cf None admin] RBAC: Authorizing `identity:get_user(user_id=dbabdd5b42334ed08a87a2bea3cbaace)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:49.815294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe75b6-5d66-4aeb-add9-723e67fba0cf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:49.818045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 64/128] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:49 2022] GET /identity/v3/users/dbabdd5b42334ed08a87a2bea3cbaace => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:49.818828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe75b6-5d66-4aeb-add9-723e67fba0cf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:49.882922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:49.904029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205f411-2b46-461b-ba97-14ee168db05f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.941249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076fc84-6193-4a62-a827-9a8ba9a2ed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.941962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076fc84-6193-4a62-a827-9a8ba9a2ed95 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.942251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076fc84-6193-4a62-a827-9a8ba9a2ed95 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.942534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076fc84-6193-4a62-a827-9a8ba9a2ed95 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:49.943333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076fc84-6193-4a62-a827-9a8ba9a2ed95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:49.943754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076fc84-6193-4a62-a827-9a8ba9a2ed95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:49.945349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076fc84-6193-4a62-a827-9a8ba9a2ed95 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:49.947301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe75b6-5d66-4aeb-add9-723e67fba0cf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:49.955416 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 65/129] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:14:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:49.956065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076fc84-6193-4a62-a827-9a8ba9a2ed95 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:49.958318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:49.994424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b8c8b-75e9-4797-a25b-f63c97ee56f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:49.995447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b8c8b-75e9-4797-a25b-f63c97ee56f2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:49.995956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b8c8b-75e9-4797-a25b-f63c97ee56f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:49.996559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b8c8b-75e9-4797-a25b-f63c97ee56f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:50.068620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076fc84-6193-4a62-a827-9a8ba9a2ed95 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:50.075249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b8c8b-75e9-4797-a25b-f63c97ee56f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:50.077681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b8c8b-75e9-4797-a25b-f63c97ee56f2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:50.105177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50160d-397c-4c5c-a710-39e606f2314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:50.106071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50160d-397c-4c5c-a710-39e606f2314c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:50.106359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50160d-397c-4c5c-a710-39e606f2314c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:50.106643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50160d-397c-4c5c-a710-39e606f2314c None admin] PATH_INFO: `/v3/projects/a2a01bd5a9694962a496a32af021e428` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:50.108614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50160d-397c-4c5c-a710-39e606f2314c None admin] RBAC: Authorizing `identity:get_project(project_id=a2a01bd5a9694962a496a32af021e428)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:50.109774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50160d-397c-4c5c-a710-39e606f2314c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:50.116712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 66/130] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:49 2022] GET /identity/v3/projects/a2a01bd5a9694962a496a32af021e428 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:50.116712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50160d-397c-4c5c-a710-39e606f2314c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:50.152961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:50.252722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 65/131] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:14:50.253575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b8c8b-75e9-4797-a25b-f63c97ee56f2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:50.278232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:50.303367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50160d-397c-4c5c-a710-39e606f2314c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:50.338613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5472-3f14-4dff-9835-3daa3fbd9487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:50.339515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5472-3f14-4dff-9835-3daa3fbd9487 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:50.339806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5472-3f14-4dff-9835-3daa3fbd9487 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:50.340110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5472-3f14-4dff-9835-3daa3fbd9487 None admin] PATH_INFO: `/v3/users/dbabdd5b42334ed08a87a2bea3cbaace` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:50.341430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e5472-3f14-4dff-9835-3daa3fbd9487 None admin] RBAC: Authorizing `identity:get_user(user_id=dbabdd5b42334ed08a87a2bea3cbaace)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:50.342978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e5472-3f14-4dff-9835-3daa3fbd9487 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:50.345215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 67/132] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:50 2022] GET /identity/v3/users/dbabdd5b42334ed08a87a2bea3cbaace => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:50.345541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5472-3f14-4dff-9835-3daa3fbd9487 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:50.433897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:50.451097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5472-3f14-4dff-9835-3daa3fbd9487 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:50.486569 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98964b-405d-4f5d-bba3-ed57363a0503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:50.487559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98964b-405d-4f5d-bba3-ed57363a0503 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:50.487848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98964b-405d-4f5d-bba3-ed57363a0503 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:50.488160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98964b-405d-4f5d-bba3-ed57363a0503 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:50.489432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98964b-405d-4f5d-bba3-ed57363a0503 None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:50.491155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98964b-405d-4f5d-bba3-ed57363a0503 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:50.492910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 68/133] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:50 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:50.493729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98964b-405d-4f5d-bba3-ed57363a0503 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:50.508024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b8c8b-75e9-4797-a25b-f63c97ee56f2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:50.547767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62384ebd-7b56-49cc-85b5-de617e97b69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:50.548713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62384ebd-7b56-49cc-85b5-de617e97b69a None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:50.548997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62384ebd-7b56-49cc-85b5-de617e97b69a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:50.549276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62384ebd-7b56-49cc-85b5-de617e97b69a None admin] PATH_INFO: `/v3/projects/a2a01bd5a9694962a496a32af021e428/users/dbabdd5b42334ed08a87a2bea3cbaace/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:50.553426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62384ebd-7b56-49cc-85b5-de617e97b69a None admin] RBAC: Authorizing `identity:create_grant(project_id=a2a01bd5a9694962a496a32af021e428, user_id=dbabdd5b42334ed08a87a2bea3cbaace, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:50.554923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62384ebd-7b56-49cc-85b5-de617e97b69a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:50.581695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 66/134] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:14:50 2022] PUT /identity/v3/projects/a2a01bd5a9694962a496a32af021e428/users/dbabdd5b42334ed08a87a2bea3cbaace/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:14:50.583958 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62384ebd-7b56-49cc-85b5-de617e97b69a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:50.667217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98964b-405d-4f5d-bba3-ed57363a0503 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:50.733863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:50.738746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b9de2-fa5c-4197-832f-5717cd67997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:50.739782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b9de2-fa5c-4197-832f-5717cd67997a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:50.740099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b9de2-fa5c-4197-832f-5717cd67997a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:50.740382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b9de2-fa5c-4197-832f-5717cd67997a None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:50.741642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b9de2-fa5c-4197-832f-5717cd67997a None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:50.743274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b9de2-fa5c-4197-832f-5717cd67997a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:50.745045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 69/135] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:50 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:50.752925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b9de2-fa5c-4197-832f-5717cd67997a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:50.798308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:50.803941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62384ebd-7b56-49cc-85b5-de617e97b69a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:50.875301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb5416-040d-4b8c-8737-e367226da3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:50.876238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5416-040d-4b8c-8737-e367226da3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:50.876572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5416-040d-4b8c-8737-e367226da3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:50.876858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5416-040d-4b8c-8737-e367226da3b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:50.877719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb5416-040d-4b8c-8737-e367226da3b5 None admin] RBAC: Adding query filter params (role.id=a72225466ad54721b9f4cc316efffc55, scope.project.id=519eba4a80c44012af4aed921a30d31b, user.id=d2fbeb193f034f3f97540e35930ec344) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:50.878044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb5416-040d-4b8c-8737-e367226da3b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:50.879735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb5416-040d-4b8c-8737-e367226da3b5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:50.887404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 67/136] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:50 2022] GET /identity/v3/role_assignments?user.id=d2fbeb193f034f3f97540e35930ec344&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=a72225466ad54721b9f4cc316efffc55 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:50.936606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b9de2-fa5c-4197-832f-5717cd67997a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:50.986320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacaa13-0cc7-405a-92f4-942aaa1144ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:50.987676 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacaa13-0cc7-405a-92f4-942aaa1144ee None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:50.988202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacaa13-0cc7-405a-92f4-942aaa1144ee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:50.988707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacaa13-0cc7-405a-92f4-942aaa1144ee None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b/users/dbabdd5b42334ed08a87a2bea3cbaace/roles/f75ffcd78e8b4fb8a4942efdd54e431f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:50.991287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacaa13-0cc7-405a-92f4-942aaa1144ee None admin] RBAC: Authorizing `identity:create_grant(project_id=519eba4a80c44012af4aed921a30d31b, user_id=dbabdd5b42334ed08a87a2bea3cbaace, role_id=f75ffcd78e8b4fb8a4942efdd54e431f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:50.993190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacaa13-0cc7-405a-92f4-942aaa1144ee None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:51.014754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 70/137] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:14:50 2022] PUT /identity/v3/projects/519eba4a80c44012af4aed921a30d31b/users/dbabdd5b42334ed08a87a2bea3cbaace/roles/f75ffcd78e8b4fb8a4942efdd54e431f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:14:51.129062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47490a-825f-4f27-ad17-596af1424751 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:51.129387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47490a-825f-4f27-ad17-596af1424751 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:51.129641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47490a-825f-4f27-ad17-596af1424751 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:51.131338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 68/138] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:51.142300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc8dc-17cb-45e7-86c7-c872f0c9e471 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:51.143256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc8dc-17cb-45e7-86c7-c872f0c9e471 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:51.143763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc8dc-17cb-45e7-86c7-c872f0c9e471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:51.171727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f8dbc8dc-17cb-45e7-86c7-c872f0c9e471 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:51.173323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f8dbc8dc-17cb-45e7-86c7-c872f0c9e471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:51.258890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 71/139] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:14:51.285480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47490a-825f-4f27-ad17-596af1424751 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:51.411764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47490a-825f-4f27-ad17-596af1424751 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:51.452260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465f609-868e-4a9e-8b61-745c297c5673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:51.453549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f609-868e-4a9e-8b61-745c297c5673 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:51.453842 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f609-868e-4a9e-8b61-745c297c5673 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:51.454124 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f609-868e-4a9e-8b61-745c297c5673 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:51.461736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:51.476049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465f609-868e-4a9e-8b61-745c297c5673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8465f609-868e-4a9e-8b61-745c297c5673 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:51.484425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:51.485242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:51.486401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 69/140] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:51.491788 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbc8dc-17cb-45e7-86c7-c872f0c9e471 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:51.512951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:51.630850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbc8dc-17cb-45e7-86c7-c872f0c9e471 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:51.675571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d442bc-9e06-4ed5-9a06-c94d9e8ae763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:51.676678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d442bc-9e06-4ed5-9a06-c94d9e8ae763 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:51.677152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d442bc-9e06-4ed5-9a06-c94d9e8ae763 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:51.677638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d442bc-9e06-4ed5-9a06-c94d9e8ae763 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:51.678613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d442bc-9e06-4ed5-9a06-c94d9e8ae763 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:51.679150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d442bc-9e06-4ed5-9a06-c94d9e8ae763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:51.680839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d442bc-9e06-4ed5-9a06-c94d9e8ae763 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:51.691228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 72/141] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:14:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:51.696905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465f609-868e-4a9e-8b61-745c297c5673 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:51.853017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465f609-868e-4a9e-8b61-745c297c5673 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:51.899628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992dd8d-f0fb-4087-9d18-e99c1ddef046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:51.900544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992dd8d-f0fb-4087-9d18-e99c1ddef046 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:51.900832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992dd8d-f0fb-4087-9d18-e99c1ddef046 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:51.901111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992dd8d-f0fb-4087-9d18-e99c1ddef046 None admin] PATH_INFO: `/v3/users/dbabdd5b42334ed08a87a2bea3cbaace` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:51.904748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992dd8d-f0fb-4087-9d18-e99c1ddef046 None admin] RBAC: Authorizing `identity:get_user(user_id=dbabdd5b42334ed08a87a2bea3cbaace)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:51.906924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992dd8d-f0fb-4087-9d18-e99c1ddef046 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:51.908909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 70/142] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:51 2022] GET /identity/v3/users/dbabdd5b42334ed08a87a2bea3cbaace => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:51.914549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d442bc-9e06-4ed5-9a06-c94d9e8ae763 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:51.995412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:52.030658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d442bc-9e06-4ed5-9a06-c94d9e8ae763 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:52.071594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52e162-54cb-4bdc-a3fe-d0ace7f9759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:52.072666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e162-54cb-4bdc-a3fe-d0ace7f9759a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:52.073139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e162-54cb-4bdc-a3fe-d0ace7f9759a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:52.073609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e162-54cb-4bdc-a3fe-d0ace7f9759a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:52.159041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52e162-54cb-4bdc-a3fe-d0ace7f9759a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:52.165442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52e162-54cb-4bdc-a3fe-d0ace7f9759a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:52.255300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2d736-1b8f-40d1-8ea0-58cf552bc122 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:52.255620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2d736-1b8f-40d1-8ea0-58cf552bc122 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:52.255873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2d736-1b8f-40d1-8ea0-58cf552bc122 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:52.257430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 71/143] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:52.263222 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8c03-6ec4-4b46-9d25-e44a2cef1819 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:52.263451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8c03-6ec4-4b46-9d25-e44a2cef1819 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:52.263739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c8c03-6ec4-4b46-9d25-e44a2cef1819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:52.264172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:52.297062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 73/144] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:14:52.302244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52e162-54cb-4bdc-a3fe-d0ace7f9759a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:52.321052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-be2c8c03-6ec4-4b46-9d25-e44a2cef1819 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:52.322291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-be2c8c03-6ec4-4b46-9d25-e44a2cef1819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:52.473385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:52.491179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 72/145] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:52.507945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52e162-54cb-4bdc-a3fe-d0ace7f9759a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:52.552720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c8c03-6ec4-4b46-9d25-e44a2cef1819 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:52.572373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348dbd7-685e-4dbf-a869-c576bd20d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:52.573262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348dbd7-685e-4dbf-a869-c576bd20d83c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:52.573545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348dbd7-685e-4dbf-a869-c576bd20d83c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:52.573823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348dbd7-685e-4dbf-a869-c576bd20d83c None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:52.575026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348dbd7-685e-4dbf-a869-c576bd20d83c None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:52.576562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348dbd7-685e-4dbf-a869-c576bd20d83c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:52.578858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 74/146] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:52 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:52.587298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348dbd7-685e-4dbf-a869-c576bd20d83c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:52.673049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:52.770495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348dbd7-685e-4dbf-a869-c576bd20d83c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:52.773679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c8c03-6ec4-4b46-9d25-e44a2cef1819 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:52.843353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09bf65-8a16-4841-9961-9c53c023ec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:52.844044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09bf65-8a16-4841-9961-9c53c023ec85 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:52.844771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c47cc-267c-4349-90ec-25e02f9f7f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:52.845587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c47cc-267c-4349-90ec-25e02f9f7f68 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:52.845873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c47cc-267c-4349-90ec-25e02f9f7f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:52.846148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c47cc-267c-4349-90ec-25e02f9f7f68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:52.846952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09bf65-8a16-4841-9961-9c53c023ec85 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:52.847230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09bf65-8a16-4841-9961-9c53c023ec85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:52.848113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09bf65-8a16-4841-9961-9c53c023ec85 None admin] RBAC: Adding query filter params (role.id=e0e319e010e342d184a4b77ac79ecf84, scope.project.id=519eba4a80c44012af4aed921a30d31b, user.id=dbabdd5b42334ed08a87a2bea3cbaace) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:52.848427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09bf65-8a16-4841-9961-9c53c023ec85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:52.850385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09bf65-8a16-4841-9961-9c53c023ec85 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:52.860337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 75/147] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:52 2022] GET /identity/v3/role_assignments?user.id=dbabdd5b42334ed08a87a2bea3cbaace&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:52.873293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c47cc-267c-4349-90ec-25e02f9f7f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5a5c47cc-267c-4349-90ec-25e02f9f7f68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:52.882348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:52.883296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:52.884075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:52.891497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 73/148] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:14:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:14:52.892853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09bf65-8a16-4841-9961-9c53c023ec85 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:53.108407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09bf65-8a16-4841-9961-9c53c023ec85 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:53.118588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:53.121647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c1f13-788e-4c10-ab3f-be3b5753ded1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:53.121947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c1f13-788e-4c10-ab3f-be3b5753ded1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:53.122224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c1f13-788e-4c10-ab3f-be3b5753ded1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:53.124063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 74/149] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:53.130010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42b06-b024-44c3-a47c-086239068a77 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:53.130460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42b06-b024-44c3-a47c-086239068a77 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:53.130561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f42b06-b024-44c3-a47c-086239068a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:53.178722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c3f42b06-b024-44c3-a47c-086239068a77 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:53.179980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c3f42b06-b024-44c3-a47c-086239068a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:53.212222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8be6b1-403f-467a-ab0b-e164bd41a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:53.220613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be6b1-403f-467a-ab0b-e164bd41a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:53.220907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be6b1-403f-467a-ab0b-e164bd41a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:53.221183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be6b1-403f-467a-ab0b-e164bd41a4c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:53.221992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8be6b1-403f-467a-ab0b-e164bd41a4c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:53.222303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8be6b1-403f-467a-ab0b-e164bd41a4c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:53.223748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8be6b1-403f-467a-ab0b-e164bd41a4c1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:53.243902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 76/150] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:53.250304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8be6b1-403f-467a-ab0b-e164bd41a4c1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:53.350547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:53.429391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 75/151] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:53.469129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f42b06-b024-44c3-a47c-086239068a77 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:53.473751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8be6b1-403f-467a-ab0b-e164bd41a4c1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:53.605741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f63d11-87be-443b-a37e-5d64f1cac377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:53.606711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f63d11-87be-443b-a37e-5d64f1cac377 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:53.607003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f63d11-87be-443b-a37e-5d64f1cac377 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:53.607286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f63d11-87be-443b-a37e-5d64f1cac377 None admin] PATH_INFO: `/v3/users/ad4863301fe44ec5b40adc370b3a51b3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:53.609992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f63d11-87be-443b-a37e-5d64f1cac377 None admin] RBAC: Authorizing `identity:get_user(user_id=ad4863301fe44ec5b40adc370b3a51b3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:53.611493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f63d11-87be-443b-a37e-5d64f1cac377 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:53.613532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 77/152] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:53 2022] GET /identity/v3/users/ad4863301fe44ec5b40adc370b3a51b3 => generated 247 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:53.618937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f63d11-87be-443b-a37e-5d64f1cac377 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:53.667071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f42b06-b024-44c3-a47c-086239068a77 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:53.685008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:53.738085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e93f44-b200-4d78-a2c2-dad4115d6249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:53.738930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e93f44-b200-4d78-a2c2-dad4115d6249 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:53.739224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e93f44-b200-4d78-a2c2-dad4115d6249 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:53.739505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e93f44-b200-4d78-a2c2-dad4115d6249 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:53.742298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e93f44-b200-4d78-a2c2-dad4115d6249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:53.743834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e93f44-b200-4d78-a2c2-dad4115d6249 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:53.745834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 76/153] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:53.755774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e93f44-b200-4d78-a2c2-dad4115d6249 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:53.832640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f63d11-87be-443b-a37e-5d64f1cac377 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:53.864531 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:53.905320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8923a8-59bc-4169-b1da-3782dd8b9d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:53.906765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8923a8-59bc-4169-b1da-3782dd8b9d67 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:53.907242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8923a8-59bc-4169-b1da-3782dd8b9d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:53.907705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8923a8-59bc-4169-b1da-3782dd8b9d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:53.929784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e93f44-b200-4d78-a2c2-dad4115d6249 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:53.965603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ab9d4-3160-46a0-a911-60a3864bd508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:53.966247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab9d4-3160-46a0-a911-60a3864bd508 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:53.966535 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab9d4-3160-46a0-a911-60a3864bd508 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:53.966809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ab9d4-3160-46a0-a911-60a3864bd508 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:53.967779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ab9d4-3160-46a0-a911-60a3864bd508 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:53.969385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ab9d4-3160-46a0-a911-60a3864bd508 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:53.995264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 77/154] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:14:53 2022] POST /identity/v3/users => generated 283 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:14:54.044786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8923a8-59bc-4169-b1da-3782dd8b9d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:54.047377 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8923a8-59bc-4169-b1da-3782dd8b9d67 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:54.112726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:54.185828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 78/155] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 18:14:54.193472 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ab9d4-3160-46a0-a911-60a3864bd508 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:54.215042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4b2b-180e-4f42-aa10-e8d089279ad5 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.215550 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4b2b-180e-4f42-aa10-e8d089279ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.215696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc4b2b-180e-4f42-aa10-e8d089279ad5 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.217339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 79/156] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:54.222695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef5d01-7b65-45b1-b09c-e6da13dd06f4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.222982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef5d01-7b65-45b1-b09c-e6da13dd06f4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.223257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef5d01-7b65-45b1-b09c-e6da13dd06f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.243845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-71ef5d01-7b65-45b1-b09c-e6da13dd06f4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:54.245266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-71ef5d01-7b65-45b1-b09c-e6da13dd06f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:54.330425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 80/157] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:14:54.332221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55315d76-6d96-452c-ac87-d2b209869381 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.332732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55315d76-6d96-452c-ac87-d2b209869381 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.333068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55315d76-6d96-452c-ac87-d2b209869381 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.334542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 81/158] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:54.339741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75950e3-11d3-4269-b387-5e2a109b81f4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.340157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75950e3-11d3-4269-b387-5e2a109b81f4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.340506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75950e3-11d3-4269-b387-5e2a109b81f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.345049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ab9d4-3160-46a0-a911-60a3864bd508 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:54.355167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:54.360212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b75950e3-11d3-4269-b387-5e2a109b81f4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:54.361524 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b75950e3-11d3-4269-b387-5e2a109b81f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:54.386650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3d5f5-f063-44f9-bcb6-041ca9e2ed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:54.387550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3d5f5-f063-44f9-bcb6-041ca9e2ed97 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.387830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3d5f5-f063-44f9-bcb6-041ca9e2ed97 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.388134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3d5f5-f063-44f9-bcb6-041ca9e2ed97 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.390168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3d5f5-f063-44f9-bcb6-041ca9e2ed97 None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:54.391732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3d5f5-f063-44f9-bcb6-041ca9e2ed97 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:54.393572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 78/159] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:54 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:54.394792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3d5f5-f063-44f9-bcb6-041ca9e2ed97 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:54.442499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:54.453933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 82/160] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:14:54.455444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75950e3-11d3-4269-b387-5e2a109b81f4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:54.528273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3d5f5-f063-44f9-bcb6-041ca9e2ed97 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:54.568633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181b52b-53bc-477c-84d2-10b85dd05b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:54.569447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181b52b-53bc-477c-84d2-10b85dd05b87 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.569728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181b52b-53bc-477c-84d2-10b85dd05b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.570050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181b52b-53bc-477c-84d2-10b85dd05b87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.585016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75950e3-11d3-4269-b387-5e2a109b81f4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:54.589606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181b52b-53bc-477c-84d2-10b85dd05b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c181b52b-53bc-477c-84d2-10b85dd05b87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:54.599376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:54.600877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 79/161] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:54.601638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e619d-d1e4-45f4-9ed8-f97547430738 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.602377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e619d-d1e4-45f4-9ed8-f97547430738 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.602377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e619d-d1e4-45f4-9ed8-f97547430738 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.603766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 80/162] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:54.605078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e619d-d1e4-45f4-9ed8-f97547430738 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:54.651818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec9e03-5f47-449b-bc3b-d7b320f873d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:54.652510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec9e03-5f47-449b-bc3b-d7b320f873d8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.652765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec9e03-5f47-449b-bc3b-d7b320f873d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.653189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec9e03-5f47-449b-bc3b-d7b320f873d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.654158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec9e03-5f47-449b-bc3b-d7b320f873d8 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=519eba4a80c44012af4aed921a30d31b, user.id=ad4863301fe44ec5b40adc370b3a51b3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:54.654158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec9e03-5f47-449b-bc3b-d7b320f873d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:54.655075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:54.655884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec9e03-5f47-449b-bc3b-d7b320f873d8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:54.662672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 83/163] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:54 2022] GET /identity/v3/role_assignments?user.id=ad4863301fe44ec5b40adc370b3a51b3&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=9f557e97d94b4b499a6765419452e1ef => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:54.663809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec9e03-5f47-449b-bc3b-d7b320f873d8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:54.758668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:54.800926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e619d-d1e4-45f4-9ed8-f97547430738 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:54.836348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec9e03-5f47-449b-bc3b-d7b320f873d8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:54.851753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354526fc-7fef-4de0-a95a-78b801e88c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:54.853071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354526fc-7fef-4de0-a95a-78b801e88c04 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.853637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354526fc-7fef-4de0-a95a-78b801e88c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.854125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354526fc-7fef-4de0-a95a-78b801e88c04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.867903 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354526fc-7fef-4de0-a95a-78b801e88c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-354526fc-7fef-4de0-a95a-78b801e88c04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:54.877102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:54.878062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:14:54.879147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:54.882529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 81/164] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:54.884320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb677-4e0e-4bb4-a178-d6055c50ba1e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.884834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb677-4e0e-4bb4-a178-d6055c50ba1e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.885300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb677-4e0e-4bb4-a178-d6055c50ba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.906457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b241-44aa-42e3-a37b-87e61cd9574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:54.907159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b241-44aa-42e3-a37b-87e61cd9574a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:54.907482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b241-44aa-42e3-a37b-87e61cd9574a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:54.907730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b241-44aa-42e3-a37b-87e61cd9574a None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:54.908375 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b17fb677-4e0e-4bb4-a178-d6055c50ba1e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:54.908496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2b241-44aa-42e3-a37b-87e61cd9574a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:54.908800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2b241-44aa-42e3-a37b-87e61cd9574a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:54.910176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b17fb677-4e0e-4bb4-a178-d6055c50ba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:54.910580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2b241-44aa-42e3-a37b-87e61cd9574a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:54.931602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 84/165] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:14:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:54.932509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b241-44aa-42e3-a37b-87e61cd9574a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:54.992940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 82/166] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:54.994138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb677-4e0e-4bb4-a178-d6055c50ba1e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:55.025222 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:55.118969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb677-4e0e-4bb4-a178-d6055c50ba1e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:55.131140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b241-44aa-42e3-a37b-87e61cd9574a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:55.161930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db71ee-339e-4dbd-95fb-78063fa5bd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:55.164568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db71ee-339e-4dbd-95fb-78063fa5bd89 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:55.167108 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db71ee-339e-4dbd-95fb-78063fa5bd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:55.169301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db71ee-339e-4dbd-95fb-78063fa5bd89 None admin] PATH_INFO: `/v3/users/d2fbeb193f034f3f97540e35930ec344` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:55.171656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db71ee-339e-4dbd-95fb-78063fa5bd89 None admin] RBAC: Authorizing `identity:get_user(user_id=d2fbeb193f034f3f97540e35930ec344)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:55.177814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db71ee-339e-4dbd-95fb-78063fa5bd89 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:55.183715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 83/167] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:54 2022] GET /identity/v3/users/d2fbeb193f034f3f97540e35930ec344 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:55.185087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:55.186551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db71ee-339e-4dbd-95fb-78063fa5bd89 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:55.213465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391a14-2563-41c8-b3a0-b20f3b64d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:55.214780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391a14-2563-41c8-b3a0-b20f3b64d46c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:55.215408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391a14-2563-41c8-b3a0-b20f3b64d46c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:55.217504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391a14-2563-41c8-b3a0-b20f3b64d46c None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:55.218666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce391a14-2563-41c8-b3a0-b20f3b64d46c None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:55.219200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce391a14-2563-41c8-b3a0-b20f3b64d46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:55.221484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce391a14-2563-41c8-b3a0-b20f3b64d46c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:55.235715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 85/168] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:14:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:55.237726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391a14-2563-41c8-b3a0-b20f3b64d46c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:55.318900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:55.332020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db71ee-339e-4dbd-95fb-78063fa5bd89 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:55.372236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f3a86-3fc7-4a0a-a71e-046251ddc2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:55.373854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3a86-3fc7-4a0a-a71e-046251ddc2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:55.374275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3a86-3fc7-4a0a-a71e-046251ddc2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:55.374680 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3a86-3fc7-4a0a-a71e-046251ddc2d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:55.390167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f3a86-3fc7-4a0a-a71e-046251ddc2d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8b9f3a86-3fc7-4a0a-a71e-046251ddc2d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:55.398718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:55.399725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:14:55.400636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:55.407686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 84/169] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:14:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:55.408993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f3a86-3fc7-4a0a-a71e-046251ddc2d6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:55.446967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391a14-2563-41c8-b3a0-b20f3b64d46c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:55.520057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971a544-d05a-4554-83cc-f0f50f17d03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:55.520898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a544-d05a-4554-83cc-f0f50f17d03c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:55.521183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a544-d05a-4554-83cc-f0f50f17d03c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:55.521465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a544-d05a-4554-83cc-f0f50f17d03c None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:55.528959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971a544-d05a-4554-83cc-f0f50f17d03c None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:55.530757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971a544-d05a-4554-83cc-f0f50f17d03c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:55.532061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f3a86-3fc7-4a0a-a71e-046251ddc2d6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:55.532606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 86/170] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:55 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:55.533395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971a544-d05a-4554-83cc-f0f50f17d03c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:55.572449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d9fa-84be-43ae-8c31-b52e5501f487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:55.573593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d9fa-84be-43ae-8c31-b52e5501f487 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:55.574014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d9fa-84be-43ae-8c31-b52e5501f487 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:55.574417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d9fa-84be-43ae-8c31-b52e5501f487 None admin] PATH_INFO: `/v3/users/dbabdd5b42334ed08a87a2bea3cbaace` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:55.575844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5d9fa-84be-43ae-8c31-b52e5501f487 None admin] RBAC: Authorizing `identity:get_user(user_id=dbabdd5b42334ed08a87a2bea3cbaace)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:55.577683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5d9fa-84be-43ae-8c31-b52e5501f487 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:55.579559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 85/171] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:55 2022] GET /identity/v3/users/dbabdd5b42334ed08a87a2bea3cbaace => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:55.580823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d9fa-84be-43ae-8c31-b52e5501f487 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:55.633959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:55.648608 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:55.765084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d9fa-84be-43ae-8c31-b52e5501f487 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:55.774159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971a544-d05a-4554-83cc-f0f50f17d03c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:55.808095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba45a2e-b2d9-445d-bf81-0da096db1ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:55.809374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba45a2e-b2d9-445d-bf81-0da096db1ba0 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:55.809802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba45a2e-b2d9-445d-bf81-0da096db1ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:55.810206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba45a2e-b2d9-445d-bf81-0da096db1ba0 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b/users/d2fbeb193f034f3f97540e35930ec344/roles/a72225466ad54721b9f4cc316efffc55` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:55.812496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba45a2e-b2d9-445d-bf81-0da096db1ba0 None admin] RBAC: Authorizing `identity:create_grant(project_id=519eba4a80c44012af4aed921a30d31b, user_id=d2fbeb193f034f3f97540e35930ec344, role_id=a72225466ad54721b9f4cc316efffc55)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:55.814233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba45a2e-b2d9-445d-bf81-0da096db1ba0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:55.827341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96d664-5d48-4475-9cea-a8989d455156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:55.828357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96d664-5d48-4475-9cea-a8989d455156 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:55.828666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96d664-5d48-4475-9cea-a8989d455156 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:55.828931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96d664-5d48-4475-9cea-a8989d455156 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:55.829712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96d664-5d48-4475-9cea-a8989d455156 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:55.830024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96d664-5d48-4475-9cea-a8989d455156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:55.831742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96d664-5d48-4475-9cea-a8989d455156 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:55.844080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 87/173] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:14:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:55.844080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96d664-5d48-4475-9cea-a8989d455156 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:55.844665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 86/173] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:14:55 2022] PUT /identity/v3/projects/519eba4a80c44012af4aed921a30d31b/users/d2fbeb193f034f3f97540e35930ec344/roles/a72225466ad54721b9f4cc316efffc55 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:14:55.850483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba45a2e-b2d9-445d-bf81-0da096db1ba0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:55.981050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96d664-5d48-4475-9cea-a8989d455156 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:56.002579 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:56.023817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b4592-b0cc-4eac-ba06-73014185db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:56.024942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b4592-b0cc-4eac-ba06-73014185db91 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:56.025371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b4592-b0cc-4eac-ba06-73014185db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:56.025941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b4592-b0cc-4eac-ba06-73014185db91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:56.100410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:56.103565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b4592-b0cc-4eac-ba06-73014185db91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:56.105289 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b4592-b0cc-4eac-ba06-73014185db91 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:56.119321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba45a2e-b2d9-445d-bf81-0da096db1ba0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:56.155228 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30fe1e-9534-4915-a619-82f11fd363f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:56.156326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30fe1e-9534-4915-a619-82f11fd363f1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:56.156821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30fe1e-9534-4915-a619-82f11fd363f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:56.157113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30fe1e-9534-4915-a619-82f11fd363f1 None admin] PATH_INFO: `/v3/users/dbabdd5b42334ed08a87a2bea3cbaace` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:56.158592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30fe1e-9534-4915-a619-82f11fd363f1 None admin] RBAC: Authorizing `identity:get_user(user_id=dbabdd5b42334ed08a87a2bea3cbaace)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:56.160190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30fe1e-9534-4915-a619-82f11fd363f1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:56.167048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 87/174] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:55 2022] GET /identity/v3/users/dbabdd5b42334ed08a87a2bea3cbaace => generated 275 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:56.168252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30fe1e-9534-4915-a619-82f11fd363f1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:56.215653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 88/175] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:14:56.221240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b4592-b0cc-4eac-ba06-73014185db91 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:56.258305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:56.308696 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30fe1e-9534-4915-a619-82f11fd363f1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:56.347435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48045b-d916-4b63-8dfb-07dbbfe09602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:56.348132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48045b-d916-4b63-8dfb-07dbbfe09602 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:56.348420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48045b-d916-4b63-8dfb-07dbbfe09602 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:56.348691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48045b-d916-4b63-8dfb-07dbbfe09602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:56.368793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b4592-b0cc-4eac-ba06-73014185db91 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:56.374835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:56.410116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbfc38-eeba-4ab1-96d8-239866c35172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:56.411028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbfc38-eeba-4ab1-96d8-239866c35172 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:56.411311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbfc38-eeba-4ab1-96d8-239866c35172 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:56.411590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbfc38-eeba-4ab1-96d8-239866c35172 None admin] PATH_INFO: `/v3/projects/a2a01bd5a9694962a496a32af021e428` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:56.413472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbfc38-eeba-4ab1-96d8-239866c35172 None admin] RBAC: Authorizing `identity:get_project(project_id=a2a01bd5a9694962a496a32af021e428)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:56.417044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbfc38-eeba-4ab1-96d8-239866c35172 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:56.420689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 89/176] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:56 2022] GET /identity/v3/projects/a2a01bd5a9694962a496a32af021e428 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:56.427790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbfc38-eeba-4ab1-96d8-239866c35172 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:56.456943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48045b-d916-4b63-8dfb-07dbbfe09602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:56.461218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48045b-d916-4b63-8dfb-07dbbfe09602 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:56.615062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:56.663541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbfc38-eeba-4ab1-96d8-239866c35172 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:56.705559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 88/177] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:14:56.725101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48045b-d916-4b63-8dfb-07dbbfe09602 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:56.745043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ea87-e014-4634-8618-5fffd88c8217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:56.745709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ea87-e014-4634-8618-5fffd88c8217 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:56.745990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ea87-e014-4634-8618-5fffd88c8217 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:56.746264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ea87-e014-4634-8618-5fffd88c8217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:56.747231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95ea87-e014-4634-8618-5fffd88c8217 None admin] RBAC: Adding query filter params (role.id=e0e319e010e342d184a4b77ac79ecf84, scope.project.id=a2a01bd5a9694962a496a32af021e428, user.id=dbabdd5b42334ed08a87a2bea3cbaace) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:56.747543 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95ea87-e014-4634-8618-5fffd88c8217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:56.749379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95ea87-e014-4634-8618-5fffd88c8217 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:56.760662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 90/178] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:56 2022] GET /identity/v3/role_assignments?user.id=dbabdd5b42334ed08a87a2bea3cbaace&scope.project.id=a2a01bd5a9694962a496a32af021e428&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:56.818703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:56.895161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48045b-d916-4b63-8dfb-07dbbfe09602 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:56.943621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83060b-cfa1-4077-a17a-7463f48a075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:56.944540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83060b-cfa1-4077-a17a-7463f48a075c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:56.944822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83060b-cfa1-4077-a17a-7463f48a075c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:56.945093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83060b-cfa1-4077-a17a-7463f48a075c None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:56.948757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83060b-cfa1-4077-a17a-7463f48a075c None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:56.950250 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83060b-cfa1-4077-a17a-7463f48a075c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:56.952350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 89/179] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:56 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:56.958221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ea87-e014-4634-8618-5fffd88c8217 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:57.117825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ea87-e014-4634-8618-5fffd88c8217 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:57.160934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615b4d8-096b-43b8-8526-40358ea0783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:57.161585 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615b4d8-096b-43b8-8526-40358ea0783c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:57.161871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615b4d8-096b-43b8-8526-40358ea0783c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:57.162148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615b4d8-096b-43b8-8526-40358ea0783c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:57.163008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615b4d8-096b-43b8-8526-40358ea0783c None admin] RBAC: Adding query filter params (role.id=f75ffcd78e8b4fb8a4942efdd54e431f, scope.project.id=519eba4a80c44012af4aed921a30d31b, user.id=dbabdd5b42334ed08a87a2bea3cbaace) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:57.163323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615b4d8-096b-43b8-8526-40358ea0783c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:57.164862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615b4d8-096b-43b8-8526-40358ea0783c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:57.176284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 91/180] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:56 2022] GET /identity/v3/role_assignments?user.id=dbabdd5b42334ed08a87a2bea3cbaace&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=f75ffcd78e8b4fb8a4942efdd54e431f => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:57.439451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443e6b5-7676-46ab-a2e8-5f85258aaf75 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:57.440049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443e6b5-7676-46ab-a2e8-5f85258aaf75 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:57.440049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443e6b5-7676-46ab-a2e8-5f85258aaf75 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:57.441827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 90/181] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:57.447350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e88671-de2a-4d25-8621-a71039d9e876 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:57.447860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e88671-de2a-4d25-8621-a71039d9e876 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:57.447928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e88671-de2a-4d25-8621-a71039d9e876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:57.472219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-07e88671-de2a-4d25-8621-a71039d9e876 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:57.473442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-07e88671-de2a-4d25-8621-a71039d9e876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:57.475720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:57.560223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 92/182] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:57.587312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443e6b5-7676-46ab-a2e8-5f85258aaf75 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:57.678692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597bcbc-a088-45bb-9e0f-c71474bb1917 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:57.679034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597bcbc-a088-45bb-9e0f-c71474bb1917 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:57.679250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597bcbc-a088-45bb-9e0f-c71474bb1917 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:57.680697 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 93/183] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:14:57.694148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302833d-92b6-484d-a8c6-5a6bd8db3ef4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:57.694332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302833d-92b6-484d-a8c6-5a6bd8db3ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:57.694614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302833d-92b6-484d-a8c6-5a6bd8db3ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:57.723310 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8302833d-92b6-484d-a8c6-5a6bd8db3ef4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:57.725115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8302833d-92b6-484d-a8c6-5a6bd8db3ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:57.727635 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443e6b5-7676-46ab-a2e8-5f85258aaf75 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:57.753462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:57.778752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999437-4ea9-4828-bd65-404cc427c381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:57.779579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999437-4ea9-4828-bd65-404cc427c381 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:57.779897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999437-4ea9-4828-bd65-404cc427c381 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:57.780446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999437-4ea9-4828-bd65-404cc427c381 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:57.798019 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a999437-4ea9-4828-bd65-404cc427c381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8a999437-4ea9-4828-bd65-404cc427c381 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:57.811409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:57.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:57.813111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 91/184] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:14:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:57.815549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999437-4ea9-4828-bd65-404cc427c381 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:57.821080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 94/185] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:14:57.829818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6d11-be6e-46e2-a725-fb752bc2b88d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:57.830105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6d11-be6e-46e2-a725-fb752bc2b88d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:57.830384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6d11-be6e-46e2-a725-fb752bc2b88d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:57.831900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 95/186] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:14:57.837044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570c20-727b-4b9b-a8c4-3836b008a4d8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:57.837400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570c20-727b-4b9b-a8c4-3836b008a4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:57.837745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570c20-727b-4b9b-a8c4-3836b008a4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:57.855925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2f570c20-727b-4b9b-a8c4-3836b008a4d8 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:57.857226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2f570c20-727b-4b9b-a8c4-3836b008a4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:57.921299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:57.928062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 96/187] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:14:57.928809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f570c20-727b-4b9b-a8c4-3836b008a4d8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:57.940792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999437-4ea9-4828-bd65-404cc427c381 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:57.981318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cabe2-20b2-4d03-8781-422d6ce2a9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:57.981906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cabe2-20b2-4d03-8781-422d6ce2a9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:57.982187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cabe2-20b2-4d03-8781-422d6ce2a9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:57.983304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cabe2-20b2-4d03-8781-422d6ce2a9e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:57.983512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cabe2-20b2-4d03-8781-422d6ce2a9e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:57.983822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cabe2-20b2-4d03-8781-422d6ce2a9e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:57.985271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cabe2-20b2-4d03-8781-422d6ce2a9e1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:58.000066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 92/188] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:58.000875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cabe2-20b2-4d03-8781-422d6ce2a9e1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:58.043142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:58.054691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f570c20-727b-4b9b-a8c4-3836b008a4d8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:58.089088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efd23e-75b0-4e70-9312-ef7e8ba73229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:58.089924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efd23e-75b0-4e70-9312-ef7e8ba73229 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:58.090191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efd23e-75b0-4e70-9312-ef7e8ba73229 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:58.090460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efd23e-75b0-4e70-9312-ef7e8ba73229 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:58.101113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efd23e-75b0-4e70-9312-ef7e8ba73229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a2efd23e-75b0-4e70-9312-ef7e8ba73229 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:58.109364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:58.110234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:14:58.116107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:14:58.116839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cabe2-20b2-4d03-8781-422d6ce2a9e1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:58.116923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 97/189] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:14:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:58.116923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efd23e-75b0-4e70-9312-ef7e8ba73229 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:58.155614 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6f174-3645-4840-91f5-89f480f9a133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:58.156450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6f174-3645-4840-91f5-89f480f9a133 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:58.156731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6f174-3645-4840-91f5-89f480f9a133 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:58.156997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6f174-3645-4840-91f5-89f480f9a133 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:58.158172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6f174-3645-4840-91f5-89f480f9a133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:58.159640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6f174-3645-4840-91f5-89f480f9a133 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:58.165671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 93/190] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:14:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:58.165671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6f174-3645-4840-91f5-89f480f9a133 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:58.180123 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:58.229048 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efd23e-75b0-4e70-9312-ef7e8ba73229 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:58.261975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeab297-652a-4e15-9b4b-e163a166e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:58.263087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeab297-652a-4e15-9b4b-e163a166e61c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:58.263368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeab297-652a-4e15-9b4b-e163a166e61c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:58.263639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeab297-652a-4e15-9b4b-e163a166e61c None admin] PATH_INFO: `/v3/users/0990450f0f7440efae8a467e4506d005` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:58.277587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeab297-652a-4e15-9b4b-e163a166e61c None admin] RBAC: Authorizing `identity:get_user(user_id=0990450f0f7440efae8a467e4506d005)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:58.277758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6f174-3645-4840-91f5-89f480f9a133 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:58.279117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeab297-652a-4e15-9b4b-e163a166e61c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:58.281110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 98/191] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:58 2022] GET /identity/v3/users/0990450f0f7440efae8a467e4506d005 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:58.281669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeab297-652a-4e15-9b4b-e163a166e61c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:58.286563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:58.318721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3772e5a-72cb-4e22-8876-9ed16c06021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:58.319398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3772e5a-72cb-4e22-8876-9ed16c06021a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:58.319683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3772e5a-72cb-4e22-8876-9ed16c06021a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:58.319957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3772e5a-72cb-4e22-8876-9ed16c06021a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:58.320749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3772e5a-72cb-4e22-8876-9ed16c06021a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:58.321059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3772e5a-72cb-4e22-8876-9ed16c06021a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:58.322456 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3772e5a-72cb-4e22-8876-9ed16c06021a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:58.331867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 94/192] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:14:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:58.331867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3772e5a-72cb-4e22-8876-9ed16c06021a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:58.402024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeab297-652a-4e15-9b4b-e163a166e61c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:58.420758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:58.437693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3772e5a-72cb-4e22-8876-9ed16c06021a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:58.443050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec63146-f845-4b79-8f9e-6be30bd857aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:58.443767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63146-f845-4b79-8f9e-6be30bd857aa None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:58.444085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63146-f845-4b79-8f9e-6be30bd857aa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:58.444365 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63146-f845-4b79-8f9e-6be30bd857aa None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:58.445103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec63146-f845-4b79-8f9e-6be30bd857aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:58.447273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec63146-f845-4b79-8f9e-6be30bd857aa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:58.476793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 99/193] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:14:58 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:14:58.478837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78f33-c4d9-4421-94e6-2065dcd523c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:58.479464 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78f33-c4d9-4421-94e6-2065dcd523c9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:58.479754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78f33-c4d9-4421-94e6-2065dcd523c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:58.480115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb78f33-c4d9-4421-94e6-2065dcd523c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:58.489126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec63146-f845-4b79-8f9e-6be30bd857aa None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:58.522812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:58.563350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78f33-c4d9-4421-94e6-2065dcd523c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:58.565039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb78f33-c4d9-4421-94e6-2065dcd523c9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:58.648299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec63146-f845-4b79-8f9e-6be30bd857aa None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:58.688300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4e1c2-016c-4baf-b326-418dbbec718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:58.689209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e1c2-016c-4baf-b326-418dbbec718b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:58.689481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e1c2-016c-4baf-b326-418dbbec718b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:58.690498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e1c2-016c-4baf-b326-418dbbec718b None admin] PATH_INFO: `/v3/users/0990450f0f7440efae8a467e4506d005` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:58.690984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4e1c2-016c-4baf-b326-418dbbec718b None admin] RBAC: Authorizing `identity:get_user(user_id=0990450f0f7440efae8a467e4506d005)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:58.692507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4e1c2-016c-4baf-b326-418dbbec718b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:58.694154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 100/194] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:58 2022] GET /identity/v3/users/0990450f0f7440efae8a467e4506d005 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:58.695374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 95/195] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:14:58.700660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4e1c2-016c-4baf-b326-418dbbec718b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:58.701885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78f33-c4d9-4421-94e6-2065dcd523c9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:58.747753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:58.789394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:58.822310 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4e1c2-016c-4baf-b326-418dbbec718b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:58.830661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb78f33-c4d9-4421-94e6-2065dcd523c9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:58.867850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf588606-1faf-4453-be4f-0e6b807b157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:58.868691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf588606-1faf-4453-be4f-0e6b807b157e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:58.868973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadbd8f-2570-4965-8e7e-01e80cc361c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:58.869082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf588606-1faf-4453-be4f-0e6b807b157e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:58.869267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf588606-1faf-4453-be4f-0e6b807b157e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:58.869845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadbd8f-2570-4965-8e7e-01e80cc361c6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:58.870198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadbd8f-2570-4965-8e7e-01e80cc361c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:58.870399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadbd8f-2570-4965-8e7e-01e80cc361c6 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:58.871584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadbd8f-2570-4965-8e7e-01e80cc361c6 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:58.873096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadbd8f-2570-4965-8e7e-01e80cc361c6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:58.875317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 96/196] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:58 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:58.876473 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16bc49-f78d-4e6b-b9ea-f9c46d2f4dea None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:58.876755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16bc49-f78d-4e6b-b9ea-f9c46d2f4dea None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:58.877033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16bc49-f78d-4e6b-b9ea-f9c46d2f4dea None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:58.878447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 97/197] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:14:58.883083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16bc49-f78d-4e6b-b9ea-f9c46d2f4dea None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:58.963277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf588606-1faf-4453-be4f-0e6b807b157e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:58.965061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf588606-1faf-4453-be4f-0e6b807b157e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:59.012897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:59.019252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16bc49-f78d-4e6b-b9ea-f9c46d2f4dea None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:59.068242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0f7e7-5328-406a-9f14-620e6078ca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:59.069219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0f7e7-5328-406a-9f14-620e6078ca2f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:59.069672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0f7e7-5328-406a-9f14-620e6078ca2f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:59.070153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0f7e7-5328-406a-9f14-620e6078ca2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:59.071393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0f7e7-5328-406a-9f14-620e6078ca2f None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99, user.id=0990450f0f7440efae8a467e4506d005) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:59.071876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0f7e7-5328-406a-9f14-620e6078ca2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:59.073536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0f7e7-5328-406a-9f14-620e6078ca2f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:59.077632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:59.081564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 98/198] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:58 2022] GET /identity/v3/role_assignments?user.id=0990450f0f7440efae8a467e4506d005&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=9f557e97d94b4b499a6765419452e1ef => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:14:59.083174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78aa6f9-4e40-43a1-ac4a-301295906bfc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:59.083661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78aa6f9-4e40-43a1-ac4a-301295906bfc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:59.084186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78aa6f9-4e40-43a1-ac4a-301295906bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:59.089660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 101/199] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 18:14:59.096039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf588606-1faf-4453-be4f-0e6b807b157e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:59.119325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e78aa6f9-4e40-43a1-ac4a-301295906bfc None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:14:59.120999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e78aa6f9-4e40-43a1-ac4a-301295906bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:14:59.220891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf588606-1faf-4453-be4f-0e6b807b157e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:59.262016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298a564-80b8-4a6f-8613-86776fc7c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:59.262914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298a564-80b8-4a6f-8613-86776fc7c3bc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:59.263190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298a564-80b8-4a6f-8613-86776fc7c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:59.263459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298a564-80b8-4a6f-8613-86776fc7c3bc None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:59.268999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298a564-80b8-4a6f-8613-86776fc7c3bc None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:59.270867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298a564-80b8-4a6f-8613-86776fc7c3bc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:59.274708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 102/200] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:14:59 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:59.281717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298a564-80b8-4a6f-8613-86776fc7c3bc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:59.296492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:59.304170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 99/201] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:14:59.337866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78aa6f9-4e40-43a1-ac4a-301295906bfc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:59.480622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298a564-80b8-4a6f-8613-86776fc7c3bc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:59.536679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78aa6f9-4e40-43a1-ac4a-301295906bfc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:59.556906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40b654-e93a-4f6a-889a-a8972e85acb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:59.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40b654-e93a-4f6a-889a-a8972e85acb6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:59.559303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40b654-e93a-4f6a-889a-a8972e85acb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:59.559939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40b654-e93a-4f6a-889a-a8972e85acb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:59.563088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40b654-e93a-4f6a-889a-a8972e85acb6 None admin] RBAC: Adding query filter params (role.id=f75ffcd78e8b4fb8a4942efdd54e431f, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99, user.id=0990450f0f7440efae8a467e4506d005) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:59.563630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40b654-e93a-4f6a-889a-a8972e85acb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:59.565507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40b654-e93a-4f6a-889a-a8972e85acb6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:59.578300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 103/202] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:14:59 2022] GET /identity/v3/role_assignments?user.id=0990450f0f7440efae8a467e4506d005&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=f75ffcd78e8b4fb8a4942efdd54e431f => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:59.588151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:59.600919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19e71-e9c4-4485-a7ec-986e32c1d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:59.602132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19e71-e9c4-4485-a7ec-986e32c1d06c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:59.602717 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19e71-e9c4-4485-a7ec-986e32c1d06c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:59.603183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19e71-e9c4-4485-a7ec-986e32c1d06c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:59.615713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e19e71-e9c4-4485-a7ec-986e32c1d06c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e0e19e71-e9c4-4485-a7ec-986e32c1d06c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:14:59.629348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:14:59.630288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:14:59.631040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:14:59.633830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 100/203] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:14:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:14:59.640438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40b654-e93a-4f6a-889a-a8972e85acb6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:59.741037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:14:59.786060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40b654-e93a-4f6a-889a-a8972e85acb6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:14:59.832029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c040e-f3d2-4f6c-bb2d-d769d0f11a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:14:59.832745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c040e-f3d2-4f6c-bb2d-d769d0f11a34 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:14:59.833024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c040e-f3d2-4f6c-bb2d-d769d0f11a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:14:59.833298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c040e-f3d2-4f6c-bb2d-d769d0f11a34 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:14:59.834086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c040e-f3d2-4f6c-bb2d-d769d0f11a34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:14:59.834393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c040e-f3d2-4f6c-bb2d-d769d0f11a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:14:59.835877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c040e-f3d2-4f6c-bb2d-d769d0f11a34 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:14:59.846341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 104/204] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:14:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:14:59.852054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19e71-e9c4-4485-a7ec-986e32c1d06c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:14:59.976735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19e71-e9c4-4485-a7ec-986e32c1d06c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:00.033870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99664ece-8c99-482b-81cf-45c77284e002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:00.034789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99664ece-8c99-482b-81cf-45c77284e002 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:00.035069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99664ece-8c99-482b-81cf-45c77284e002 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:00.035344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99664ece-8c99-482b-81cf-45c77284e002 None admin] PATH_INFO: `/v3/users/d2fbeb193f034f3f97540e35930ec344` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:00.036591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99664ece-8c99-482b-81cf-45c77284e002 None admin] RBAC: Authorizing `identity:get_user(user_id=d2fbeb193f034f3f97540e35930ec344)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:00.038158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99664ece-8c99-482b-81cf-45c77284e002 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:00.040136 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 101/205] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:14:59 2022] GET /identity/v3/users/d2fbeb193f034f3f97540e35930ec344 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:00.046078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c040e-f3d2-4f6c-bb2d-d769d0f11a34 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:00.182985 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c040e-f3d2-4f6c-bb2d-d769d0f11a34 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:00.217502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac59db-731f-45c6-9db1-bc6aa68f8f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:00.218464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac59db-731f-45c6-9db1-bc6aa68f8f1a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:00.218748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac59db-731f-45c6-9db1-bc6aa68f8f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:00.219024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac59db-731f-45c6-9db1-bc6aa68f8f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:00.221766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:00.287773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac59db-731f-45c6-9db1-bc6aa68f8f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:00.289309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac59db-731f-45c6-9db1-bc6aa68f8f1a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:00.389233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 105/206] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:00.394960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99664ece-8c99-482b-81cf-45c77284e002 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:00.489765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:00.544179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99664ece-8c99-482b-81cf-45c77284e002 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:00.591032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ed70c-43e2-4ee0-b70e-3cb9679e5f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:00.591911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ed70c-43e2-4ee0-b70e-3cb9679e5f38 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:00.592223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ed70c-43e2-4ee0-b70e-3cb9679e5f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:00.592547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ed70c-43e2-4ee0-b70e-3cb9679e5f38 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:00.594470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ed70c-43e2-4ee0-b70e-3cb9679e5f38 None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:00.595968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ed70c-43e2-4ee0-b70e-3cb9679e5f38 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:00.597777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 102/207] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:00 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:00.603799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac59db-731f-45c6-9db1-bc6aa68f8f1a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:00.654664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:00.747748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac59db-731f-45c6-9db1-bc6aa68f8f1a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:00.797035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845333f2-f7ca-4a16-95cd-11f91c078b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:00.798095 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845333f2-f7ca-4a16-95cd-11f91c078b10 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:00.798567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845333f2-f7ca-4a16-95cd-11f91c078b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:00.799045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845333f2-f7ca-4a16-95cd-11f91c078b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:00.800100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845333f2-f7ca-4a16-95cd-11f91c078b10 None admin] RBAC: Adding query filter params (role.id=a72225466ad54721b9f4cc316efffc55, scope.project.id=519eba4a80c44012af4aed921a30d31b, user.id=d2fbeb193f034f3f97540e35930ec344) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:00.800601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845333f2-f7ca-4a16-95cd-11f91c078b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:00.802320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845333f2-f7ca-4a16-95cd-11f91c078b10 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:00.812115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 106/208] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:00 2022] GET /identity/v3/role_assignments?user.id=d2fbeb193f034f3f97540e35930ec344&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=a72225466ad54721b9f4cc316efffc55 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:01.053314 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fcf5f-7076-465c-9d2a-6345650fe94d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:01.053665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fcf5f-7076-465c-9d2a-6345650fe94d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:01.053834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fcf5f-7076-465c-9d2a-6345650fe94d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:01.055519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 103/209] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:01.060776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845aa9b-84da-49aa-8730-1952d11f3792 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:01.061104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845aa9b-84da-49aa-8730-1952d11f3792 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:01.061443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845aa9b-84da-49aa-8730-1952d11f3792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:01.084282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0845aa9b-84da-49aa-8730-1952d11f3792 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:01.085495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0845aa9b-84da-49aa-8730-1952d11f3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:01.174323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 107/210] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:01.200551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fcf5f-7076-465c-9d2a-6345650fe94d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:01.329402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fcf5f-7076-465c-9d2a-6345650fe94d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:01.362087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:01.372148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dceec5-1e5f-4070-a952-dee10fc378e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:01.372961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dceec5-1e5f-4070-a952-dee10fc378e1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:01.373241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dceec5-1e5f-4070-a952-dee10fc378e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:01.373620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dceec5-1e5f-4070-a952-dee10fc378e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:01.377732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e81f-9c8c-4b60-bce6-9a553520de40 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:01.378026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e81f-9c8c-4b60-bce6-9a553520de40 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:01.378309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e81f-9c8c-4b60-bce6-9a553520de40 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:01.379710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 108/211] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:15:01.384652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f63385-52f3-4814-af4e-9add2e42298b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:01.384765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dceec5-1e5f-4070-a952-dee10fc378e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:01.384961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f63385-52f3-4814-af4e-9add2e42298b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:01.385216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f63385-52f3-4814-af4e-9add2e42298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-46dceec5-1e5f-4070-a952-dee10fc378e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:01.394689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:01.395582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:01.396385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:01.396961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 104/212] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:01.401508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dceec5-1e5f-4070-a952-dee10fc378e1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:01.406368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d8f63385-52f3-4814-af4e-9add2e42298b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:01.407545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d8f63385-52f3-4814-af4e-9add2e42298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:01.432944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:01.480506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 109/213] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:01.505906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f63385-52f3-4814-af4e-9add2e42298b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:01.506697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dceec5-1e5f-4070-a952-dee10fc378e1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:01.541220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72568051-e694-42f6-996f-48d342b92ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:01.542253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72568051-e694-42f6-996f-48d342b92ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:01.542539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72568051-e694-42f6-996f-48d342b92ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:01.542813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72568051-e694-42f6-996f-48d342b92ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:01.543568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72568051-e694-42f6-996f-48d342b92ba1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:01.543875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72568051-e694-42f6-996f-48d342b92ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:01.545295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72568051-e694-42f6-996f-48d342b92ba1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:01.554173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 105/214] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:01.559343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72568051-e694-42f6-996f-48d342b92ba1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:01.620703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:01.633510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f63385-52f3-4814-af4e-9add2e42298b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:01.677475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72568051-e694-42f6-996f-48d342b92ba1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:01.687191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e44f3-8218-49f5-96da-933401357548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:01.688500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e44f3-8218-49f5-96da-933401357548 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:01.688836 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e44f3-8218-49f5-96da-933401357548 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:01.689505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e44f3-8218-49f5-96da-933401357548 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:01.691014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e44f3-8218-49f5-96da-933401357548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:01.693263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e44f3-8218-49f5-96da-933401357548 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:01.696050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 110/215] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:01.700769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e44f3-8218-49f5-96da-933401357548 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:01.715039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d566c0d-a11c-4bec-8a27-836ce1230514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:01.715932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566c0d-a11c-4bec-8a27-836ce1230514 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:01.716240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566c0d-a11c-4bec-8a27-836ce1230514 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:01.716511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d566c0d-a11c-4bec-8a27-836ce1230514 None admin] PATH_INFO: `/v3/users/f1b83983ab7848ce9965c99a0fcb87fa` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:01.735133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d566c0d-a11c-4bec-8a27-836ce1230514 None admin] RBAC: Authorizing `identity:get_user(user_id=f1b83983ab7848ce9965c99a0fcb87fa)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:01.736657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d566c0d-a11c-4bec-8a27-836ce1230514 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:01.743061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 106/216] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:01 2022] GET /identity/v3/users/f1b83983ab7848ce9965c99a0fcb87fa => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:01.743711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:01.744531 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d566c0d-a11c-4bec-8a27-836ce1230514 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:01.816972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e44f3-8218-49f5-96da-933401357548 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:01.855247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d566c0d-a11c-4bec-8a27-836ce1230514 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:01.856019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a348325-1a31-4c4e-a26c-42988168e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:01.856737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a348325-1a31-4c4e-a26c-42988168e325 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:01.857021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a348325-1a31-4c4e-a26c-42988168e325 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:01.857297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a348325-1a31-4c4e-a26c-42988168e325 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:01.858225 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a348325-1a31-4c4e-a26c-42988168e325 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:01.859714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a348325-1a31-4c4e-a26c-42988168e325 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:01.863515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:01.887332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 111/217] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:15:01 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:15:01.906847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4102d-50c0-4e6e-b132-648c562dec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:01.907722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4102d-50c0-4e6e-b132-648c562dec7d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:01.908153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4102d-50c0-4e6e-b132-648c562dec7d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:01.908437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4102d-50c0-4e6e-b132-648c562dec7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:01.993211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4102d-50c0-4e6e-b132-648c562dec7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:01.994816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4102d-50c0-4e6e-b132-648c562dec7d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:02.112869 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 107/218] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:02.118491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a348325-1a31-4c4e-a26c-42988168e325 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:02.181605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e726f7-f21f-43a8-85c1-9fd968072c0f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:02.182212 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e726f7-f21f-43a8-85c1-9fd968072c0f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:02.182495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e726f7-f21f-43a8-85c1-9fd968072c0f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:02.184676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 108/219] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:02.190603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ddbe7-c70d-495f-a322-a191eb970643 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:02.190892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ddbe7-c70d-495f-a322-a191eb970643 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:02.191169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ddbe7-c70d-495f-a322-a191eb970643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:02.206211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:02.212627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-029ddbe7-c70d-495f-a322-a191eb970643 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:02.213729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:02.214209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-029ddbe7-c70d-495f-a322-a191eb970643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:02.245475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a348325-1a31-4c4e-a26c-42988168e325 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:02.288688 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157a4b4-6277-42b2-a7a9-f17eca5b7f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:02.289721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a4b4-6277-42b2-a7a9-f17eca5b7f0c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:02.290003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a4b4-6277-42b2-a7a9-f17eca5b7f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:02.290277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a4b4-6277-42b2-a7a9-f17eca5b7f0c None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:02.291677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157a4b4-6277-42b2-a7a9-f17eca5b7f0c None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:02.297839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157a4b4-6277-42b2-a7a9-f17eca5b7f0c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:02.299680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 112/220] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:02 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:02.307845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157a4b4-6277-42b2-a7a9-f17eca5b7f0c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:02.310525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 109/221] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:02.334058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ddbe7-c70d-495f-a322-a191eb970643 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:02.441561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157a4b4-6277-42b2-a7a9-f17eca5b7f0c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:02.454749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ddbe7-c70d-495f-a322-a191eb970643 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:02.488195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792be75e-309e-4713-ac40-16bc061bc75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:02.489193 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792be75e-309e-4713-ac40-16bc061bc75f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:02.489674 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792be75e-309e-4713-ac40-16bc061bc75f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:02.490144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792be75e-309e-4713-ac40-16bc061bc75f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:02.491207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792be75e-309e-4713-ac40-16bc061bc75f None admin] RBAC: Adding query filter params (role.id=e0e319e010e342d184a4b77ac79ecf84, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99, user.id=f1b83983ab7848ce9965c99a0fcb87fa) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:02.491426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028198-bb3a-4fbf-884a-6f518b81acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:02.491712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792be75e-309e-4713-ac40-16bc061bc75f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:02.492578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028198-bb3a-4fbf-884a-6f518b81acae None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:02.493002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028198-bb3a-4fbf-884a-6f518b81acae None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:02.493432 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028198-bb3a-4fbf-884a-6f518b81acae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:02.493619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792be75e-309e-4713-ac40-16bc061bc75f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:02.497035 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:02.504456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 113/222] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:02 2022] GET /identity/v3/role_assignments?user.id=f1b83983ab7848ce9965c99a0fcb87fa&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:02.506011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f2bc-b637-40f5-8a5e-17245f2a42ef None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:02.506375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f2bc-b637-40f5-8a5e-17245f2a42ef None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:02.507022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f2bc-b637-40f5-8a5e-17245f2a42ef None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:02.507639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028198-bb3a-4fbf-884a-6f518b81acae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:02.508937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 114/223] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0e028198-bb3a-4fbf-884a-6f518b81acae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:02.516471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:02.517428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:02.518236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:02.521237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 110/224] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:02.521603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb460354-66ea-4d58-baa7-b0afe9faa79e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:02.521891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb460354-66ea-4d58-baa7-b0afe9faa79e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:02.522165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb460354-66ea-4d58-baa7-b0afe9faa79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:02.537298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028198-bb3a-4fbf-884a-6f518b81acae None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:02.548220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-eb460354-66ea-4d58-baa7-b0afe9faa79e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:02.549542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eb460354-66ea-4d58-baa7-b0afe9faa79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:02.568438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:02.634758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 115/225] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:02.658515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb460354-66ea-4d58-baa7-b0afe9faa79e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:02.773368 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028198-bb3a-4fbf-884a-6f518b81acae None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:02.792123 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb460354-66ea-4d58-baa7-b0afe9faa79e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:02.830929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4c5bd-db02-4da1-8222-bc9115aed31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:02.831759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4c5bd-db02-4da1-8222-bc9115aed31d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:02.832060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4c5bd-db02-4da1-8222-bc9115aed31d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:02.832340 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4c5bd-db02-4da1-8222-bc9115aed31d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:02.846630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87b2a-d077-46bc-90a6-adaf82ea707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:02.847363 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87b2a-d077-46bc-90a6-adaf82ea707c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:02.847649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87b2a-d077-46bc-90a6-adaf82ea707c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:02.847924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87b2a-d077-46bc-90a6-adaf82ea707c None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:02.850335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e87b2a-d077-46bc-90a6-adaf82ea707c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:02.850651 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e87b2a-d077-46bc-90a6-adaf82ea707c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:02.852088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e87b2a-d077-46bc-90a6-adaf82ea707c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:02.856722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4c5bd-db02-4da1-8222-bc9115aed31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-58c4c5bd-db02-4da1-8222-bc9115aed31d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:02.869433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:02.870335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:02.871112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:02.874349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 111/226] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:02.875199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 116/227] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:15:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:02.880041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87b2a-d077-46bc-90a6-adaf82ea707c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:02.897981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4c5bd-db02-4da1-8222-bc9115aed31d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:02.901922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:03.004113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:03.033398 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4c5bd-db02-4da1-8222-bc9115aed31d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:03.077297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a7ea2-27c5-4444-be61-85e388bc75db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:03.077992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7ea2-27c5-4444-be61-85e388bc75db None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:03.078269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7ea2-27c5-4444-be61-85e388bc75db None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:03.078537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7ea2-27c5-4444-be61-85e388bc75db None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:03.079307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a7ea2-27c5-4444-be61-85e388bc75db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:03.079612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a7ea2-27c5-4444-be61-85e388bc75db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:03.084411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a7ea2-27c5-4444-be61-85e388bc75db None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:03.102682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 117/228] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:03.104034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87b2a-d077-46bc-90a6-adaf82ea707c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:03.107963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a7ea2-27c5-4444-be61-85e388bc75db None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:03.145122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ae7e-4917-4903-81ae-55c60c356c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:03.146011 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ae7e-4917-4903-81ae-55c60c356c4d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:03.146295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ae7e-4917-4903-81ae-55c60c356c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:03.146581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ae7e-4917-4903-81ae-55c60c356c4d None admin] PATH_INFO: `/v3/users/0990450f0f7440efae8a467e4506d005` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:03.151165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999ae7e-4917-4903-81ae-55c60c356c4d None admin] RBAC: Authorizing `identity:get_user(user_id=0990450f0f7440efae8a467e4506d005)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:03.152671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999ae7e-4917-4903-81ae-55c60c356c4d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:03.158741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 112/229] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:02 2022] GET /identity/v3/users/0990450f0f7440efae8a467e4506d005 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:03.161351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ae7e-4917-4903-81ae-55c60c356c4d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:03.237069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:03.277360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a7ea2-27c5-4444-be61-85e388bc75db None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:03.320243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88639dea-ff73-4a1d-bd6a-f32b43d3fc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:03.321143 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88639dea-ff73-4a1d-bd6a-f32b43d3fc08 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:03.321421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88639dea-ff73-4a1d-bd6a-f32b43d3fc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:03.321691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88639dea-ff73-4a1d-bd6a-f32b43d3fc08 None admin] PATH_INFO: `/v3/users/0990450f0f7440efae8a467e4506d005` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:03.324192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88639dea-ff73-4a1d-bd6a-f32b43d3fc08 None admin] RBAC: Authorizing `identity:get_user(user_id=0990450f0f7440efae8a467e4506d005)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:03.325670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88639dea-ff73-4a1d-bd6a-f32b43d3fc08 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:03.331853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 118/230] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:03 2022] GET /identity/v3/users/0990450f0f7440efae8a467e4506d005 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:03.332747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88639dea-ff73-4a1d-bd6a-f32b43d3fc08 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:03.375016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ae7e-4917-4903-81ae-55c60c356c4d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:03.408594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:03.419015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87bb19-b7cc-4172-85f3-39d9bed57c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:03.419944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87bb19-b7cc-4172-85f3-39d9bed57c1f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:03.420246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87bb19-b7cc-4172-85f3-39d9bed57c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:03.420546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87bb19-b7cc-4172-85f3-39d9bed57c1f None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:03.424897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87bb19-b7cc-4172-85f3-39d9bed57c1f None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:03.426392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87bb19-b7cc-4172-85f3-39d9bed57c1f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:03.428131 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 113/231] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:03 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:03.434408 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87bb19-b7cc-4172-85f3-39d9bed57c1f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:03.517619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88639dea-ff73-4a1d-bd6a-f32b43d3fc08 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:03.564738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8be7dd-b8de-4929-8020-bbf43b477f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:03.565592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8be7dd-b8de-4929-8020-bbf43b477f14 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:03.565873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8be7dd-b8de-4929-8020-bbf43b477f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:03.566151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8be7dd-b8de-4929-8020-bbf43b477f14 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:03.572737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8be7dd-b8de-4929-8020-bbf43b477f14 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:03.574240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8be7dd-b8de-4929-8020-bbf43b477f14 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:03.575980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 119/232] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:03 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:03.582089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8be7dd-b8de-4929-8020-bbf43b477f14 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:03.590470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:03.605146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87bb19-b7cc-4172-85f3-39d9bed57c1f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:03.639877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a400c-a6fc-4a0a-8d40-7399670d1b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:03.640974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a400c-a6fc-4a0a-8d40-7399670d1b55 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:03.641351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a400c-a6fc-4a0a-8d40-7399670d1b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:03.641725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a400c-a6fc-4a0a-8d40-7399670d1b55 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/users/0990450f0f7440efae8a467e4506d005/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:03.643988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a400c-a6fc-4a0a-8d40-7399670d1b55 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed3cb2d0a5a4281957591c2420a9b99, user_id=0990450f0f7440efae8a467e4506d005, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:03.645577 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a400c-a6fc-4a0a-8d40-7399670d1b55 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:03.671488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 114/233] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:15:03 2022] PUT /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/users/0990450f0f7440efae8a467e4506d005/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:03.750055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8be7dd-b8de-4929-8020-bbf43b477f14 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:03.802753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3365ef-dd33-4580-ac39-b34445af7f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:03.804155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3365ef-dd33-4580-ac39-b34445af7f04 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:03.804638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3365ef-dd33-4580-ac39-b34445af7f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:03.805101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3365ef-dd33-4580-ac39-b34445af7f04 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/users/0990450f0f7440efae8a467e4506d005/roles/f75ffcd78e8b4fb8a4942efdd54e431f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:03.814230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3365ef-dd33-4580-ac39-b34445af7f04 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed3cb2d0a5a4281957591c2420a9b99, user_id=0990450f0f7440efae8a467e4506d005, role_id=f75ffcd78e8b4fb8a4942efdd54e431f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:03.816227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3365ef-dd33-4580-ac39-b34445af7f04 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:03.851349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 120/234] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:15:03 2022] PUT /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/users/0990450f0f7440efae8a467e4506d005/roles/f75ffcd78e8b4fb8a4942efdd54e431f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:15:04.618484 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6820132-4a9c-4a78-b4cf-d21363eebd8e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:04.619491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6820132-4a9c-4a78-b4cf-d21363eebd8e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:04.619988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6820132-4a9c-4a78-b4cf-d21363eebd8e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:04.621617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 115/235] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:04.637691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f45a3-4a3b-401c-994e-290829788c61 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:04.638274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f45a3-4a3b-401c-994e-290829788c61 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:04.638745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f45a3-4a3b-401c-994e-290829788c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:04.662054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9a7f45a3-4a3b-401c-994e-290829788c61 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:04.663621 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9a7f45a3-4a3b-401c-994e-290829788c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:04.733109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817773-5331-432a-a528-d9cdda07071b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:04.733749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817773-5331-432a-a528-d9cdda07071b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:04.734240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36817773-5331-432a-a528-d9cdda07071b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:04.735814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 116/236] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:04.737371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:04.742518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505929-7cba-4db4-a46e-1509d0782e56 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:04.743102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505929-7cba-4db4-a46e-1509d0782e56 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:04.743568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc505929-7cba-4db4-a46e-1509d0782e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:04.767158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dc505929-7cba-4db4-a46e-1509d0782e56 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:04.768840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 121/237] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:04.770645 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dc505929-7cba-4db4-a46e-1509d0782e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:04.845134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f45a3-4a3b-401c-994e-290829788c61 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:04.860516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:04.901009 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 117/238] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:04.929373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc505929-7cba-4db4-a46e-1509d0782e56 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:05.033535 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc505929-7cba-4db4-a46e-1509d0782e56 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:05.035709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f45a3-4a3b-401c-994e-290829788c61 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:05.072261 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d11325-f101-411a-bd2e-f0e8721094c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:05.073451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d11325-f101-411a-bd2e-f0e8721094c2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:05.073930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d11325-f101-411a-bd2e-f0e8721094c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:05.074427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d11325-f101-411a-bd2e-f0e8721094c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:05.075885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d11325-f101-411a-bd2e-f0e8721094c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:05.077705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d11325-f101-411a-bd2e-f0e8721094c2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:05.079866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 118/239] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:05.088985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d11325-f101-411a-bd2e-f0e8721094c2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:05.111654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa961-0cce-41e9-b7c0-cde35043028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:05.112513 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa961-0cce-41e9-b7c0-cde35043028c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:05.112801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa961-0cce-41e9-b7c0-cde35043028c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:05.113070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fa961-0cce-41e9-b7c0-cde35043028c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:05.134212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fa961-0cce-41e9-b7c0-cde35043028c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-155fa961-0cce-41e9-b7c0-cde35043028c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:05.146134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:05.147036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:05.147806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 122/240] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:05.159210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa961-0cce-41e9-b7c0-cde35043028c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:05.181927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:05.260433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d11325-f101-411a-bd2e-f0e8721094c2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:05.262226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:05.327215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fa961-0cce-41e9-b7c0-cde35043028c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:05.329382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aacb3-0270-47f4-9795-303d273e0ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:05.331191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aacb3-0270-47f4-9795-303d273e0ca7 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:05.331720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aacb3-0270-47f4-9795-303d273e0ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:05.332220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aacb3-0270-47f4-9795-303d273e0ca7 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:05.333175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733aacb3-0270-47f4-9795-303d273e0ca7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:05.335384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733aacb3-0270-47f4-9795-303d273e0ca7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:05.364915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 119/241] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:15:05 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:15:05.365926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9213a3d-5102-4f68-aca5-8f057596ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:05.366685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75a3a1-cd8f-43a1-b389-5b1221cdcc8b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:05.367055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9213a3d-5102-4f68-aca5-8f057596ea69 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:05.367165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75a3a1-cd8f-43a1-b389-5b1221cdcc8b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:05.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75a3a1-cd8f-43a1-b389-5b1221cdcc8b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:05.367736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9213a3d-5102-4f68-aca5-8f057596ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:05.368196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9213a3d-5102-4f68-aca5-8f057596ea69 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:05.369159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 120/242] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:05.369369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9213a3d-5102-4f68-aca5-8f057596ea69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:05.369798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9213a3d-5102-4f68-aca5-8f057596ea69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:05.371536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9213a3d-5102-4f68-aca5-8f057596ea69 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:05.376078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48407c-57f1-465a-8e8e-a212a45b8f49 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:05.376646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48407c-57f1-465a-8e8e-a212a45b8f49 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:05.377100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48407c-57f1-465a-8e8e-a212a45b8f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:05.385412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 123/243] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:05.391472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9213a3d-5102-4f68-aca5-8f057596ea69 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:05.395911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ef48407c-57f1-465a-8e8e-a212a45b8f49 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:05.397347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ef48407c-57f1-465a-8e8e-a212a45b8f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:05.490520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 121/244] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:05.541420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9213a3d-5102-4f68-aca5-8f057596ea69 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:05.563531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:05.571622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48407c-57f1-465a-8e8e-a212a45b8f49 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:05.599774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b0cb3-b0bc-4d4a-8a3f-662eaa31b361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:05.600723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0cb3-b0bc-4d4a-8a3f-662eaa31b361 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:05.601003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0cb3-b0bc-4d4a-8a3f-662eaa31b361 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:05.601280 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0cb3-b0bc-4d4a-8a3f-662eaa31b361 None admin] PATH_INFO: `/v3/users/999085775296440d98c8df6ba835efa2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:05.632059 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b0cb3-b0bc-4d4a-8a3f-662eaa31b361 None admin] RBAC: Authorizing `identity:get_user(user_id=999085775296440d98c8df6ba835efa2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:05.633735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b0cb3-b0bc-4d4a-8a3f-662eaa31b361 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:05.636563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 124/245] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:05 2022] GET /identity/v3/users/999085775296440d98c8df6ba835efa2 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:05.646320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b0cb3-b0bc-4d4a-8a3f-662eaa31b361 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:05.657033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:05.725853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48407c-57f1-465a-8e8e-a212a45b8f49 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:05.754231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b0cb3-b0bc-4d4a-8a3f-662eaa31b361 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:05.772479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068d35f-f100-4edd-8cd9-34f657fa7caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:05.773312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068d35f-f100-4edd-8cd9-34f657fa7caa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:05.773594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068d35f-f100-4edd-8cd9-34f657fa7caa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:05.773867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068d35f-f100-4edd-8cd9-34f657fa7caa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:05.789803 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fdf90-f3d0-4361-b7e9-79629ed41ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:05.790473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fdf90-f3d0-4361-b7e9-79629ed41ffe None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:05.790755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fdf90-f3d0-4361-b7e9-79629ed41ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:05.791031 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fdf90-f3d0-4361-b7e9-79629ed41ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:05.792888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068d35f-f100-4edd-8cd9-34f657fa7caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0068d35f-f100-4edd-8cd9-34f657fa7caa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:05.800971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:05.801931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:05.802679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 122/246] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:05.809986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068d35f-f100-4edd-8cd9-34f657fa7caa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:05.846195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:05.885192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fdf90-f3d0-4361-b7e9-79629ed41ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:05.886692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fdf90-f3d0-4361-b7e9-79629ed41ffe None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:05.960393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:05.965772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068d35f-f100-4edd-8cd9-34f657fa7caa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:06.018873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9fdef-2293-46a3-960b-a3ba32490a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:06.019625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9fdef-2293-46a3-960b-a3ba32490a64 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:06.019916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9fdef-2293-46a3-960b-a3ba32490a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:06.020223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9fdef-2293-46a3-960b-a3ba32490a64 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:06.020996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9fdef-2293-46a3-960b-a3ba32490a64 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:06.021299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9fdef-2293-46a3-960b-a3ba32490a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:06.022983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9fdef-2293-46a3-960b-a3ba32490a64 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:06.035027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 123/247] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:06.036947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 125/248] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:06.040674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9fdef-2293-46a3-960b-a3ba32490a64 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:06.042785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fdf90-f3d0-4361-b7e9-79629ed41ffe None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:06.125757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:06.163591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fdf90-f3d0-4361-b7e9-79629ed41ffe None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:06.176065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9fdef-2293-46a3-960b-a3ba32490a64 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:06.217906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58b96-2183-49df-bcbd-e954985cd5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:06.219932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58b96-2183-49df-bcbd-e954985cd5ff None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:06.220875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58b96-2183-49df-bcbd-e954985cd5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:06.221754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58b96-2183-49df-bcbd-e954985cd5ff None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:06.224728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb16680-26a0-4b7d-879a-56726eb6c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:06.225364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58b96-2183-49df-bcbd-e954985cd5ff None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:06.227035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58b96-2183-49df-bcbd-e954985cd5ff None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:06.228127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb16680-26a0-4b7d-879a-56726eb6c94f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:06.228581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb16680-26a0-4b7d-879a-56726eb6c94f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:06.229017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb16680-26a0-4b7d-879a-56726eb6c94f None admin] PATH_INFO: `/v3/users/f1b83983ab7848ce9965c99a0fcb87fa` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:06.230924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 126/249] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:06 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:06.232364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb16680-26a0-4b7d-879a-56726eb6c94f None admin] RBAC: Authorizing `identity:get_user(user_id=f1b83983ab7848ce9965c99a0fcb87fa)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:06.234125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb16680-26a0-4b7d-879a-56726eb6c94f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:06.235988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 124/250] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:06 2022] GET /identity/v3/users/f1b83983ab7848ce9965c99a0fcb87fa => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:06.237299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58b96-2183-49df-bcbd-e954985cd5ff None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:06.241888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb16680-26a0-4b7d-879a-56726eb6c94f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:06.291595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:06.414587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58b96-2183-49df-bcbd-e954985cd5ff None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:06.420683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb16680-26a0-4b7d-879a-56726eb6c94f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:06.480215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85670e24-0434-42af-b897-410fb2f4a62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:06.481093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85670e24-0434-42af-b897-410fb2f4a62f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:06.481375 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85670e24-0434-42af-b897-410fb2f4a62f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:06.482063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf837ac-1e03-4ffa-98d9-228417be10ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:06.482764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf837ac-1e03-4ffa-98d9-228417be10ae None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:06.483234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf837ac-1e03-4ffa-98d9-228417be10ae None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:06.483710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf837ac-1e03-4ffa-98d9-228417be10ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:06.484386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf837ac-1e03-4ffa-98d9-228417be10ae None admin] RBAC: Adding query filter params (role.id=a72225466ad54721b9f4cc316efffc55, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99, user.id=999085775296440d98c8df6ba835efa2) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:06.484697 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf837ac-1e03-4ffa-98d9-228417be10ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:06.486176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf837ac-1e03-4ffa-98d9-228417be10ae None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:06.488142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85670e24-0434-42af-b897-410fb2f4a62f None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:06.489499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85670e24-0434-42af-b897-410fb2f4a62f None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:06.490961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85670e24-0434-42af-b897-410fb2f4a62f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:06.492712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 125/251] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:06 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:06.493933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cdc65-e2b1-4872-aee2-b6d74672b577 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:06.494216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cdc65-e2b1-4872-aee2-b6d74672b577 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:06.494491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cdc65-e2b1-4872-aee2-b6d74672b577 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:06.500929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 126/252] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:06.501760 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cdc65-e2b1-4872-aee2-b6d74672b577 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:06.502390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 127/253] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:06 2022] GET /identity/v3/role_assignments?user.id=999085775296440d98c8df6ba835efa2&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=a72225466ad54721b9f4cc316efffc55 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:06.503691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408c65-412f-4d6a-8e44-d8c43c1297f6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:06.503976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408c65-412f-4d6a-8e44-d8c43c1297f6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:06.506703 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408c65-412f-4d6a-8e44-d8c43c1297f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:06.533121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:06.537231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-49408c65-412f-4d6a-8e44-d8c43c1297f6 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:06.538452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-49408c65-412f-4d6a-8e44-d8c43c1297f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:06.723826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 128/254] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:06.743376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:06.756078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cdc65-e2b1-4872-aee2-b6d74672b577 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:06.765749 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408c65-412f-4d6a-8e44-d8c43c1297f6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:06.814246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25f40f-553c-4a78-965a-d843fd9a0efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:06.815539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25f40f-553c-4a78-965a-d843fd9a0efc None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:06.816097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25f40f-553c-4a78-965a-d843fd9a0efc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:06.816589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25f40f-553c-4a78-965a-d843fd9a0efc None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/users/f1b83983ab7848ce9965c99a0fcb87fa/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:06.821308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25f40f-553c-4a78-965a-d843fd9a0efc None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed3cb2d0a5a4281957591c2420a9b99, user_id=f1b83983ab7848ce9965c99a0fcb87fa, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:06.823027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25f40f-553c-4a78-965a-d843fd9a0efc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:06.847902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 127/255] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:15:06 2022] PUT /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/users/f1b83983ab7848ce9965c99a0fcb87fa/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:06.946843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408c65-412f-4d6a-8e44-d8c43c1297f6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:07.000991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc0103-47a3-43b1-85f3-5c285e90b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:07.001754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc0103-47a3-43b1-85f3-5c285e90b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:07.002054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc0103-47a3-43b1-85f3-5c285e90b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:07.002339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc0103-47a3-43b1-85f3-5c285e90b3b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:07.004815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:07.015019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc0103-47a3-43b1-85f3-5c285e90b3b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b0bc0103-47a3-43b1-85f3-5c285e90b3b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:07.025333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:07.026236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:07.026993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 129/256] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:07.033183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25f40f-553c-4a78-965a-d843fd9a0efc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:07.081458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d8ba1-4d7b-4965-a4ed-0082f7381c72 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:07.081804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d8ba1-4d7b-4965-a4ed-0082f7381c72 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:07.082024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d8ba1-4d7b-4965-a4ed-0082f7381c72 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:07.083710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 130/257] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:07.088856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618de955-7570-4f5f-a720-8faa61daf5d5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:07.089146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618de955-7570-4f5f-a720-8faa61daf5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:07.089425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618de955-7570-4f5f-a720-8faa61daf5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:07.120635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-618de955-7570-4f5f-a720-8faa61daf5d5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:07.126035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-618de955-7570-4f5f-a720-8faa61daf5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:07.232032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25f40f-553c-4a78-965a-d843fd9a0efc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:07.264725 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 131/258] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:07.274048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d8746-799f-4317-8a66-0e8989b16d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:07.274738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d8746-799f-4317-8a66-0e8989b16d92 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:07.275018 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d8746-799f-4317-8a66-0e8989b16d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:07.275294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d8746-799f-4317-8a66-0e8989b16d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:07.276065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d8746-799f-4317-8a66-0e8989b16d92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:07.276373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d8746-799f-4317-8a66-0e8989b16d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:07.277775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d8746-799f-4317-8a66-0e8989b16d92 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:07.286869 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 128/259] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:07.293105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618de955-7570-4f5f-a720-8faa61daf5d5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:07.305933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d8746-799f-4317-8a66-0e8989b16d92 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:07.344778 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:07.418979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618de955-7570-4f5f-a720-8faa61daf5d5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:07.444929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d8746-799f-4317-8a66-0e8989b16d92 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:07.451649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:07.477289 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25ff37-9d53-4af2-9fc1-e952ecf48a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:07.478208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25ff37-9d53-4af2-9fc1-e952ecf48a89 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:07.478491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25ff37-9d53-4af2-9fc1-e952ecf48a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:07.478766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25ff37-9d53-4af2-9fc1-e952ecf48a89 None admin] PATH_INFO: `/v3/users/0990450f0f7440efae8a467e4506d005` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:07.479991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25ff37-9d53-4af2-9fc1-e952ecf48a89 None admin] RBAC: Authorizing `identity:get_user(user_id=0990450f0f7440efae8a467e4506d005)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:07.481553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25ff37-9d53-4af2-9fc1-e952ecf48a89 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:07.484141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 132/260] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:07 2022] GET /identity/v3/users/0990450f0f7440efae8a467e4506d005 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:07.489429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25ff37-9d53-4af2-9fc1-e952ecf48a89 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:07.504129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd313f-877e-4574-89ca-3310da21284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:07.504978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd313f-877e-4574-89ca-3310da21284a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:07.505255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd313f-877e-4574-89ca-3310da21284a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:07.505529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd313f-877e-4574-89ca-3310da21284a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:07.522992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd313f-877e-4574-89ca-3310da21284a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0bbd313f-877e-4574-89ca-3310da21284a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:07.531585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:07.532573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:07.533332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:07.545055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 129/261] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:15:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:07.551090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd313f-877e-4574-89ca-3310da21284a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:07.704400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:07.715387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25ff37-9d53-4af2-9fc1-e952ecf48a89 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:07.732259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd313f-877e-4574-89ca-3310da21284a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:07.773165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620a1b-91db-4a62-b258-937abd021d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:07.773785 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620a1b-91db-4a62-b258-937abd021d4a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:07.774030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620a1b-91db-4a62-b258-937abd021d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:07.774307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35620a1b-91db-4a62-b258-937abd021d4a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:07.775066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620a1b-91db-4a62-b258-937abd021d4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:07.775371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620a1b-91db-4a62-b258-937abd021d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:07.781723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35620a1b-91db-4a62-b258-937abd021d4a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:07.798312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 130/262] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:07.801233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14b541-de52-47a6-a5cc-44d0a5f977f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:07.801905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14b541-de52-47a6-a5cc-44d0a5f977f5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:07.802185 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14b541-de52-47a6-a5cc-44d0a5f977f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:07.802461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14b541-de52-47a6-a5cc-44d0a5f977f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:07.803924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620a1b-91db-4a62-b258-937abd021d4a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:07.909006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:07.925583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14b541-de52-47a6-a5cc-44d0a5f977f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:07.927082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14b541-de52-47a6-a5cc-44d0a5f977f5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:07.967129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35620a1b-91db-4a62-b258-937abd021d4a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:08.047658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94c0e-d543-43bd-8edc-493304f5ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:08.048491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94c0e-d543-43bd-8edc-493304f5ce1a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:08.048773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94c0e-d543-43bd-8edc-493304f5ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:08.049043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae94c0e-d543-43bd-8edc-493304f5ce1a None admin] PATH_INFO: `/v3/users/0990450f0f7440efae8a467e4506d005` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:08.051388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94c0e-d543-43bd-8edc-493304f5ce1a None admin] RBAC: Authorizing `identity:get_user(user_id=0990450f0f7440efae8a467e4506d005)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:08.053694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae94c0e-d543-43bd-8edc-493304f5ce1a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:08.062264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 131/263] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:07 2022] GET /identity/v3/users/0990450f0f7440efae8a467e4506d005 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:08.063116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94c0e-d543-43bd-8edc-493304f5ce1a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:08.084784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:08.176063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 133/264] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:08.181763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14b541-de52-47a6-a5cc-44d0a5f977f5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:08.244532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae94c0e-d543-43bd-8edc-493304f5ce1a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:08.303765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004074e-cf2a-4fac-b9a2-e382822ade37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:08.304384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004074e-cf2a-4fac-b9a2-e382822ade37 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:08.304665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004074e-cf2a-4fac-b9a2-e382822ade37 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:08.304937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004074e-cf2a-4fac-b9a2-e382822ade37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:08.414865 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:08.444093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14b541-de52-47a6-a5cc-44d0a5f977f5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:08.505067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004074e-cf2a-4fac-b9a2-e382822ade37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:08.506558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004074e-cf2a-4fac-b9a2-e382822ade37 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:08.510532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec951-0322-452c-819a-82e151affe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:08.511440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec951-0322-452c-819a-82e151affe17 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:08.511720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec951-0322-452c-819a-82e151affe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:08.511995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec951-0322-452c-819a-82e151affe17 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:08.515080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbec951-0322-452c-819a-82e151affe17 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:08.516745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbec951-0322-452c-819a-82e151affe17 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:08.524413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 134/265] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:08 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:08.528948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec951-0322-452c-819a-82e151affe17 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:08.530881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:08.738845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec951-0322-452c-819a-82e151affe17 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:08.756325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 132/266] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:08.764972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004074e-cf2a-4fac-b9a2-e382822ade37 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:08.829656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9a91-eb4c-4a63-b15f-ffbc5cb38931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:08.830692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9a91-eb4c-4a63-b15f-ffbc5cb38931 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:08.831164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9a91-eb4c-4a63-b15f-ffbc5cb38931 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:08.831650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d9a91-eb4c-4a63-b15f-ffbc5cb38931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:08.832712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d9a91-eb4c-4a63-b15f-ffbc5cb38931 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99, user.id=0990450f0f7440efae8a467e4506d005) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:08.833217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d9a91-eb4c-4a63-b15f-ffbc5cb38931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:08.834890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d9a91-eb4c-4a63-b15f-ffbc5cb38931 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:08.848773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 135/267] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:08 2022] GET /identity/v3/role_assignments?user.id=0990450f0f7440efae8a467e4506d005&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=9f557e97d94b4b499a6765419452e1ef => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:08.963927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004074e-cf2a-4fac-b9a2-e382822ade37 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:08.982430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:09.017805 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b90a30-ad01-4cce-ac23-2740f679d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:09.018638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b90a30-ad01-4cce-ac23-2740f679d776 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.019066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b90a30-ad01-4cce-ac23-2740f679d776 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.019347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b90a30-ad01-4cce-ac23-2740f679d776 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.020607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b90a30-ad01-4cce-ac23-2740f679d776 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:09.022113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b90a30-ad01-4cce-ac23-2740f679d776 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:09.024022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 133/268] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:08 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:09.030177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9a91-eb4c-4a63-b15f-ffbc5cb38931 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:09.046280 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99679468-1154-47b8-9483-26269c9820a1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.046613 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99679468-1154-47b8-9483-26269c9820a1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.046851 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99679468-1154-47b8-9483-26269c9820a1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.052319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 134/269] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:09.058239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9872d66-56d4-4a0c-b389-10f3cf73a37d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.058542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9872d66-56d4-4a0c-b389-10f3cf73a37d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.058821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9872d66-56d4-4a0c-b389-10f3cf73a37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.085292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:09.086108 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f9872d66-56d4-4a0c-b389-10f3cf73a37d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:09.087354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f9872d66-56d4-4a0c-b389-10f3cf73a37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:09.220630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 135/270] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:09.232273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d9a91-eb4c-4a63-b15f-ffbc5cb38931 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:09.274446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d4ca7-3b7a-4d5f-99ce-be7185305771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:09.275036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d4ca7-3b7a-4d5f-99ce-be7185305771 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.275319 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d4ca7-3b7a-4d5f-99ce-be7185305771 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.275599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d4ca7-3b7a-4d5f-99ce-be7185305771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.276476 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d4ca7-3b7a-4d5f-99ce-be7185305771 None admin] RBAC: Adding query filter params (role.id=f75ffcd78e8b4fb8a4942efdd54e431f, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99, user.id=0990450f0f7440efae8a467e4506d005) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:09.276792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d4ca7-3b7a-4d5f-99ce-be7185305771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:09.278276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d4ca7-3b7a-4d5f-99ce-be7185305771 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:09.287489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6832f-96b0-4848-9aed-2cef4a82a2a6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.288274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6832f-96b0-4848-9aed-2cef4a82a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.288868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6832f-96b0-4848-9aed-2cef4a82a2a6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.290550 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 136/271] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:09 2022] GET /identity/v3/role_assignments?user.id=0990450f0f7440efae8a467e4506d005&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=f75ffcd78e8b4fb8a4942efdd54e431f => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:09.290921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 136/272] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:15:09.297469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f60f7-33c5-497e-ba39-afeb4ba1e15e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.297775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f60f7-33c5-497e-ba39-afeb4ba1e15e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.298032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f60f7-33c5-497e-ba39-afeb4ba1e15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.303650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6832f-96b0-4848-9aed-2cef4a82a2a6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:09.321228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ae1f60f7-33c5-497e-ba39-afeb4ba1e15e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:09.322987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ae1f60f7-33c5-497e-ba39-afeb4ba1e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:09.461589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 137/273] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:09.468359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6832f-96b0-4848-9aed-2cef4a82a2a6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:09.480405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:09.515489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab57f7-57f3-4489-bed9-7bdf97630baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:09.516361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab57f7-57f3-4489-bed9-7bdf97630baa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.516648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab57f7-57f3-4489-bed9-7bdf97630baa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.516926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab57f7-57f3-4489-bed9-7bdf97630baa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.527743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f60f7-33c5-497e-ba39-afeb4ba1e15e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:09.544180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab57f7-57f3-4489-bed9-7bdf97630baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:09.556893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-caab57f7-57f3-4489-bed9-7bdf97630baa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:09.558164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:09.559196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:09.560187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:09.568171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 137/274] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:09.570278 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab57f7-57f3-4489-bed9-7bdf97630baa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:09.672263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f60f7-33c5-497e-ba39-afeb4ba1e15e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:09.689350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab57f7-57f3-4489-bed9-7bdf97630baa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:09.709786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd2c50-c9bf-4e9d-9041-85bedb946911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:09.710996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd2c50-c9bf-4e9d-9041-85bedb946911 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.711474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd2c50-c9bf-4e9d-9041-85bedb946911 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.711942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd2c50-c9bf-4e9d-9041-85bedb946911 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.713487 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd2c50-c9bf-4e9d-9041-85bedb946911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:09.715359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd2c50-c9bf-4e9d-9041-85bedb946911 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:09.717521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 138/275] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:09.723498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd2c50-c9bf-4e9d-9041-85bedb946911 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:09.727783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0a363-6f2f-43f4-b937-083ff03a824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:09.728518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0a363-6f2f-43f4-b937-083ff03a824a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.729706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0a363-6f2f-43f4-b937-083ff03a824a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.729706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0a363-6f2f-43f4-b937-083ff03a824a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.729876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0a363-6f2f-43f4-b937-083ff03a824a None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:09.730151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0a363-6f2f-43f4-b937-083ff03a824a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:09.731615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0a363-6f2f-43f4-b937-083ff03a824a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:09.744114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 138/276] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:09.748321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0a363-6f2f-43f4-b937-083ff03a824a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:09.782306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:09.831860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:09.850455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd2c50-c9bf-4e9d-9041-85bedb946911 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:09.860495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0a363-6f2f-43f4-b937-083ff03a824a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:09.887800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d744d-08f6-45c5-bfa0-3a06eb3b198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:09.888522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d744d-08f6-45c5-bfa0-3a06eb3b198d None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.888807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d744d-08f6-45c5-bfa0-3a06eb3b198d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.889117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d744d-08f6-45c5-bfa0-3a06eb3b198d None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.889923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d744d-08f6-45c5-bfa0-3a06eb3b198d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:09.891389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d744d-08f6-45c5-bfa0-3a06eb3b198d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:09.900639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a6ffc-10a0-4913-a2ad-742006f5896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:09.901496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6ffc-10a0-4913-a2ad-742006f5896a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.901818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6ffc-10a0-4913-a2ad-742006f5896a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.902106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6ffc-10a0-4913-a2ad-742006f5896a None admin] PATH_INFO: `/v3/users/121d4fa98059416799aae9f4501861ac` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.914367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 139/277] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:15:09 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:15:09.916087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed647-92cf-43d7-8990-5450f33ce130 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.916747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed647-92cf-43d7-8990-5450f33ce130 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.917535 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a6ffc-10a0-4913-a2ad-742006f5896a None admin] RBAC: Authorizing `identity:get_user(user_id=121d4fa98059416799aae9f4501861ac)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:09.917775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed647-92cf-43d7-8990-5450f33ce130 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.919058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a6ffc-10a0-4913-a2ad-742006f5896a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:09.919589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 140/278] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:09.925792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 139/279] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:09 2022] GET /identity/v3/users/121d4fa98059416799aae9f4501861ac => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:09.927739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a6ffc-10a0-4913-a2ad-742006f5896a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:09.928393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672e28-8d4e-47ea-8ee3-0a419664ea60 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:09.929044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672e28-8d4e-47ea-8ee3-0a419664ea60 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:09.929520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672e28-8d4e-47ea-8ee3-0a419664ea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:09.950114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b5672e28-8d4e-47ea-8ee3-0a419664ea60 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:09.951835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b5672e28-8d4e-47ea-8ee3-0a419664ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:10.028792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:10.055211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 141/280] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:10.055598 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a6ffc-10a0-4913-a2ad-742006f5896a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:10.081941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5672e28-8d4e-47ea-8ee3-0a419664ea60 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:10.097904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25431d-bf52-4284-9ef0-9a2c8fe98b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:10.098582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25431d-bf52-4284-9ef0-9a2c8fe98b91 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:10.098866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25431d-bf52-4284-9ef0-9a2c8fe98b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:10.099144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25431d-bf52-4284-9ef0-9a2c8fe98b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:10.100038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25431d-bf52-4284-9ef0-9a2c8fe98b91 None admin] RBAC: Adding query filter params (role.id=e0e319e010e342d184a4b77ac79ecf84, user.id=121d4fa98059416799aae9f4501861ac, scope.system=all) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:10.100353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25431d-bf52-4284-9ef0-9a2c8fe98b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:10.101883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25431d-bf52-4284-9ef0-9a2c8fe98b91 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:10.108101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 140/281] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Jun 4 18:15:09 2022] GET /identity/v3/role_assignments?user.id=121d4fa98059416799aae9f4501861ac&scope.system=all&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:10.109438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1352ac-e88a-42f7-8f7c-2094510dc517 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:10.109730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1352ac-e88a-42f7-8f7c-2094510dc517 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:10.110010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1352ac-e88a-42f7-8f7c-2094510dc517 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:10.111857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 141/282] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:10.120269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea289a-2f35-4e59-88ba-130e8cceb2a4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:10.121119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea289a-2f35-4e59-88ba-130e8cceb2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:10.121577 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea289a-2f35-4e59-88ba-130e8cceb2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:10.144993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d4ea289a-2f35-4e59-88ba-130e8cceb2a4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:10.146550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d4ea289a-2f35-4e59-88ba-130e8cceb2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:10.171686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:10.213659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5672e28-8d4e-47ea-8ee3-0a419664ea60 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:10.250259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 142/283] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:10.261597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c90cac-5e59-4f6d-a97d-59ce22649b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:10.262518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c90cac-5e59-4f6d-a97d-59ce22649b06 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:10.262864 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c90cac-5e59-4f6d-a97d-59ce22649b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:10.263201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c90cac-5e59-4f6d-a97d-59ce22649b06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:10.276217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c90cac-5e59-4f6d-a97d-59ce22649b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:10.276415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea289a-2f35-4e59-88ba-130e8cceb2a4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f1c90cac-5e59-4f6d-a97d-59ce22649b06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:10.284421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:10.285359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:10.286120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 142/284] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:10.295826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c90cac-5e59-4f6d-a97d-59ce22649b06 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:10.391939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:10.417593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea289a-2f35-4e59-88ba-130e8cceb2a4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:10.437018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c90cac-5e59-4f6d-a97d-59ce22649b06 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:10.454133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae82a-d061-4f30-96cc-f90ca3114136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:10.454944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae82a-d061-4f30-96cc-f90ca3114136 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:10.455225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae82a-d061-4f30-96cc-f90ca3114136 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:10.455599 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae82a-d061-4f30-96cc-f90ca3114136 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:10.466466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cae82a-d061-4f30-96cc-f90ca3114136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e0cae82a-d061-4f30-96cc-f90ca3114136 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:10.474708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:10.475789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:10.476633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 143/285] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:10.481798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae82a-d061-4f30-96cc-f90ca3114136 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:10.495837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:10.503225 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974add6-2218-4450-bba7-fdd9310cf301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:10.503928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974add6-2218-4450-bba7-fdd9310cf301 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:10.508472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974add6-2218-4450-bba7-fdd9310cf301 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:10.508764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974add6-2218-4450-bba7-fdd9310cf301 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:10.509657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974add6-2218-4450-bba7-fdd9310cf301 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:10.510049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974add6-2218-4450-bba7-fdd9310cf301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:10.511577 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974add6-2218-4450-bba7-fdd9310cf301 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:10.528432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 143/286] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:10.534322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974add6-2218-4450-bba7-fdd9310cf301 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:10.634810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae82a-d061-4f30-96cc-f90ca3114136 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:10.698296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e000f6-d24f-48d6-a4cb-555ccd19f671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:10.699072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e000f6-d24f-48d6-a4cb-555ccd19f671 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:10.699352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e000f6-d24f-48d6-a4cb-555ccd19f671 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:10.699623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e000f6-d24f-48d6-a4cb-555ccd19f671 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:10.700573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e000f6-d24f-48d6-a4cb-555ccd19f671 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:10.700931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e000f6-d24f-48d6-a4cb-555ccd19f671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:10.702443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e000f6-d24f-48d6-a4cb-555ccd19f671 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:10.718756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 144/287] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:10.720748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974add6-2218-4450-bba7-fdd9310cf301 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:10.723650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e000f6-d24f-48d6-a4cb-555ccd19f671 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:10.728781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:10.787039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f10a80-07d3-4db8-bfa3-a633f4c1342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:10.787938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f10a80-07d3-4db8-bfa3-a633f4c1342d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:10.788242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f10a80-07d3-4db8-bfa3-a633f4c1342d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:10.788512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f10a80-07d3-4db8-bfa3-a633f4c1342d None admin] PATH_INFO: `/v3/users/999085775296440d98c8df6ba835efa2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:10.790814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f10a80-07d3-4db8-bfa3-a633f4c1342d None admin] RBAC: Authorizing `identity:get_user(user_id=999085775296440d98c8df6ba835efa2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:10.792690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f10a80-07d3-4db8-bfa3-a633f4c1342d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:10.794326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 144/288] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:10 2022] GET /identity/v3/users/999085775296440d98c8df6ba835efa2 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:10.801085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f10a80-07d3-4db8-bfa3-a633f4c1342d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:10.890240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e000f6-d24f-48d6-a4cb-555ccd19f671 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:10.896578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:10.933310 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99311e-d93d-49c6-a9da-6ac5248d3516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:10.934331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99311e-d93d-49c6-a9da-6ac5248d3516 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:10.934610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99311e-d93d-49c6-a9da-6ac5248d3516 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:10.934883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99311e-d93d-49c6-a9da-6ac5248d3516 None admin] PATH_INFO: `/v3/users/f1b83983ab7848ce9965c99a0fcb87fa` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:10.937017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99311e-d93d-49c6-a9da-6ac5248d3516 None admin] RBAC: Authorizing `identity:get_user(user_id=f1b83983ab7848ce9965c99a0fcb87fa)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:10.939109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99311e-d93d-49c6-a9da-6ac5248d3516 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:10.941079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 145/289] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:10 2022] GET /identity/v3/users/f1b83983ab7848ce9965c99a0fcb87fa => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:10.946943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99311e-d93d-49c6-a9da-6ac5248d3516 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:10.974506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f10a80-07d3-4db8-bfa3-a633f4c1342d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:11.044155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e24ff-b4f0-4412-9271-9c134326a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:11.045053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e24ff-b4f0-4412-9271-9c134326a629 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:11.045360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e24ff-b4f0-4412-9271-9c134326a629 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:11.046301 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e24ff-b4f0-4412-9271-9c134326a629 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:11.048263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e24ff-b4f0-4412-9271-9c134326a629 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:11.049743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e24ff-b4f0-4412-9271-9c134326a629 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:11.052682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 145/290] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:10 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:11.058636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e24ff-b4f0-4412-9271-9c134326a629 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:11.080919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:11.121846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99311e-d93d-49c6-a9da-6ac5248d3516 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:11.188819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f3cf0-44f9-41b1-b138-cd6734ae664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:11.189482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f3cf0-44f9-41b1-b138-cd6734ae664c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:11.189756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f3cf0-44f9-41b1-b138-cd6734ae664c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:11.190026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f3cf0-44f9-41b1-b138-cd6734ae664c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:11.253972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e24ff-b4f0-4412-9271-9c134326a629 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:11.297914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:11.309827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a9e2-fc71-4098-b2b8-af20295f917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:11.310950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a9e2-fc71-4098-b2b8-af20295f917f None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:11.311371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a9e2-fc71-4098-b2b8-af20295f917f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:11.311779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280a9e2-fc71-4098-b2b8-af20295f917f None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/users/999085775296440d98c8df6ba835efa2/roles/a72225466ad54721b9f4cc316efffc55` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:11.318265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a9e2-fc71-4098-b2b8-af20295f917f None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed3cb2d0a5a4281957591c2420a9b99, user_id=999085775296440d98c8df6ba835efa2, role_id=a72225466ad54721b9f4cc316efffc55)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:11.320831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280a9e2-fc71-4098-b2b8-af20295f917f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:11.323903 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f3cf0-44f9-41b1-b138-cd6734ae664c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:11.325548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f3cf0-44f9-41b1-b138-cd6734ae664c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:11.347633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 146/291] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:15:11 2022] PUT /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/users/999085775296440d98c8df6ba835efa2/roles/a72225466ad54721b9f4cc316efffc55 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:11.429894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:11.480290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 146/292] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:11.486161 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a9e2-fc71-4098-b2b8-af20295f917f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:11.640277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280a9e2-fc71-4098-b2b8-af20295f917f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:11.683645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a0310-1d67-4bc5-8f25-7da067352e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:11.684559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0310-1d67-4bc5-8f25-7da067352e67 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:11.684845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0310-1d67-4bc5-8f25-7da067352e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:11.685126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0310-1d67-4bc5-8f25-7da067352e67 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:11.686870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a0310-1d67-4bc5-8f25-7da067352e67 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:11.688423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a0310-1d67-4bc5-8f25-7da067352e67 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:11.690459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 147/293] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:11 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:11.695907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f3cf0-44f9-41b1-b138-cd6734ae664c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:11.860343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f3cf0-44f9-41b1-b138-cd6734ae664c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:11.904262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51752bf5-4a62-46d9-a10c-d22f1adfb83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:11.905904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752bf5-4a62-46d9-a10c-d22f1adfb83b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:11.906419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752bf5-4a62-46d9-a10c-d22f1adfb83b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:11.906885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51752bf5-4a62-46d9-a10c-d22f1adfb83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:11.907909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51752bf5-4a62-46d9-a10c-d22f1adfb83b None admin] RBAC: Adding query filter params (role.id=e0e319e010e342d184a4b77ac79ecf84, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99, user.id=f1b83983ab7848ce9965c99a0fcb87fa) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:11.908437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51752bf5-4a62-46d9-a10c-d22f1adfb83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:11.910093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51752bf5-4a62-46d9-a10c-d22f1adfb83b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:11.922090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 147/294] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:11 2022] GET /identity/v3/role_assignments?user.id=f1b83983ab7848ce9965c99a0fcb87fa&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:12.713336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45b718-1fd9-4a8c-bfd6-e7bc677f2747 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:12.713866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45b718-1fd9-4a8c-bfd6-e7bc677f2747 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:12.713866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45b718-1fd9-4a8c-bfd6-e7bc677f2747 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:12.715261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 148/295] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:12.720788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca84e2f-fb77-4a58-a3b8-4b4f2c5b5287 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:12.721600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca84e2f-fb77-4a58-a3b8-4b4f2c5b5287 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:12.722068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca84e2f-fb77-4a58-a3b8-4b4f2c5b5287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:12.740093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4ca84e2f-fb77-4a58-a3b8-4b4f2c5b5287 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:12.741635 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4ca84e2f-fb77-4a58-a3b8-4b4f2c5b5287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:12.750834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03042c3c-19ae-43f0-b0cb-f55baacc346d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:12.751456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03042c3c-19ae-43f0-b0cb-f55baacc346d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:12.751928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03042c3c-19ae-43f0-b0cb-f55baacc346d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:12.753536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 149/296] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:15:12.759270 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5db1c-e9fc-45ee-bd31-fe15fbf9bdb9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:12.759922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5db1c-e9fc-45ee-bd31-fe15fbf9bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:12.760428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5db1c-e9fc-45ee-bd31-fe15fbf9bdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:12.771623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:12.784910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-71e5db1c-e9fc-45ee-bd31-fe15fbf9bdb9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:12.786433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-71e5db1c-e9fc-45ee-bd31-fe15fbf9bdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:12.820828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 148/297] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:12.844438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca84e2f-fb77-4a58-a3b8-4b4f2c5b5287 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:12.862114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:12.889878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 150/298] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:12.912977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5db1c-e9fc-45ee-bd31-fe15fbf9bdb9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:12.951164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca84e2f-fb77-4a58-a3b8-4b4f2c5b5287 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:12.988062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf45cbe-9754-45fe-aedd-6010f9a9c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:12.988793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45cbe-9754-45fe-aedd-6010f9a9c86e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:12.989075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45cbe-9754-45fe-aedd-6010f9a9c86e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:12.989374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf45cbe-9754-45fe-aedd-6010f9a9c86e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:12.999667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf45cbe-9754-45fe-aedd-6010f9a9c86e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-abf45cbe-9754-45fe-aedd-6010f9a9c86e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:13.007259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:13.008243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 149/299] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:13.009928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de1784-edad-4d01-aedb-ef3d34fcd09f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.010622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de1784-edad-4d01-aedb-ef3d34fcd09f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.010622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de1784-edad-4d01-aedb-ef3d34fcd09f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.011690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 150/300] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:13.015563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de1784-edad-4d01-aedb-ef3d34fcd09f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:13.041171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5db1c-e9fc-45ee-bd31-fe15fbf9bdb9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:13.043260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:13.080979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455dee5-fc9d-4ffe-8d3d-9a8054201c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:13.081785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455dee5-fc9d-4ffe-8d3d-9a8054201c67 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.082066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455dee5-fc9d-4ffe-8d3d-9a8054201c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.082337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455dee5-fc9d-4ffe-8d3d-9a8054201c67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.094593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455dee5-fc9d-4ffe-8d3d-9a8054201c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1455dee5-fc9d-4ffe-8d3d-9a8054201c67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:13.102812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:13.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:13.104507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 151/301] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:13.105605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6195d-4870-4af5-9edf-b86bb18e1a84 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.105605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6195d-4870-4af5-9edf-b86bb18e1a84 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.105831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6195d-4870-4af5-9edf-b86bb18e1a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.122827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fdf6195d-4870-4af5-9edf-b86bb18e1a84 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:13.124564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fdf6195d-4870-4af5-9edf-b86bb18e1a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:13.129445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de1784-edad-4d01-aedb-ef3d34fcd09f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:13.168604 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4500e7-af16-4d72-bc12-aa2e35c233f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:13.169294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4500e7-af16-4d72-bc12-aa2e35c233f4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.169574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4500e7-af16-4d72-bc12-aa2e35c233f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.169851 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4500e7-af16-4d72-bc12-aa2e35c233f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.170653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4500e7-af16-4d72-bc12-aa2e35c233f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:13.171259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4500e7-af16-4d72-bc12-aa2e35c233f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:13.172394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4500e7-af16-4d72-bc12-aa2e35c233f4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:13.172664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:13.182904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 151/302] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:13.182904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4500e7-af16-4d72-bc12-aa2e35c233f4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:13.198671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 152/303] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:13.201080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6195d-4870-4af5-9edf-b86bb18e1a84 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:13.282017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:13.302491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4500e7-af16-4d72-bc12-aa2e35c233f4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:13.317425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6195d-4870-4af5-9edf-b86bb18e1a84 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:13.339422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f9d85-a5e5-44c6-963f-5b21d245de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:13.340181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9d85-a5e5-44c6-963f-5b21d245de2b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.340407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9d85-a5e5-44c6-963f-5b21d245de2b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.340683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9d85-a5e5-44c6-963f-5b21d245de2b None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.341436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f9d85-a5e5-44c6-963f-5b21d245de2b None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:13.341745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f9d85-a5e5-44c6-963f-5b21d245de2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:13.343224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f9d85-a5e5-44c6-963f-5b21d245de2b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:13.356509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 152/304] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:13.356509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f9d85-a5e5-44c6-963f-5b21d245de2b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:13.359229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6b1bc-4f72-4f0e-9d34-3336c350277f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:13.360176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6b1bc-4f72-4f0e-9d34-3336c350277f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.360465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6b1bc-4f72-4f0e-9d34-3336c350277f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.360804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6b1bc-4f72-4f0e-9d34-3336c350277f None admin] PATH_INFO: `/v3/users/ec3334e433d248ab9c103acb60d4f0f4` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.376574 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6b1bc-4f72-4f0e-9d34-3336c350277f None admin] RBAC: Authorizing `identity:get_user(user_id=ec3334e433d248ab9c103acb60d4f0f4)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:13.378509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6b1bc-4f72-4f0e-9d34-3336c350277f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:13.380272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 153/305] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:13 2022] GET /identity/v3/users/ec3334e433d248ab9c103acb60d4f0f4 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:13.380272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6b1bc-4f72-4f0e-9d34-3336c350277f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:13.417977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:13.471129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f9d85-a5e5-44c6-963f-5b21d245de2b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:13.488732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6b1bc-4f72-4f0e-9d34-3336c350277f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:13.510008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da69fc-7b4c-474c-a575-095eb336986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:13.510834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da69fc-7b4c-474c-a575-095eb336986f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.511125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da69fc-7b4c-474c-a575-095eb336986f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.511400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da69fc-7b4c-474c-a575-095eb336986f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.512684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da69fc-7b4c-474c-a575-095eb336986f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:13.514338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da69fc-7b4c-474c-a575-095eb336986f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:13.516396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 153/306] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:13.517043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da69fc-7b4c-474c-a575-095eb336986f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:13.533181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fdf62-40a7-4b18-b4cf-8906abd28ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:13.533923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fdf62-40a7-4b18-b4cf-8906abd28ecb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.534211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fdf62-40a7-4b18-b4cf-8906abd28ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.534705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fdf62-40a7-4b18-b4cf-8906abd28ecb None admin] PATH_INFO: `/v3/users/121d4fa98059416799aae9f4501861ac` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.535676 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fdf62-40a7-4b18-b4cf-8906abd28ecb None admin] RBAC: Authorizing `identity:get_user(user_id=121d4fa98059416799aae9f4501861ac)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:13.537170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fdf62-40a7-4b18-b4cf-8906abd28ecb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:13.537617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:13.538831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 154/307] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:13 2022] GET /identity/v3/users/121d4fa98059416799aae9f4501861ac => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:13.540899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fdf62-40a7-4b18-b4cf-8906abd28ecb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:13.625302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da69fc-7b4c-474c-a575-095eb336986f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:13.647351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fdf62-40a7-4b18-b4cf-8906abd28ecb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:13.649940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:13.664861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa998e-9c4c-41d4-88e0-dff38072366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:13.665529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa998e-9c4c-41d4-88e0-dff38072366e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.665817 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa998e-9c4c-41d4-88e0-dff38072366e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.666095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa998e-9c4c-41d4-88e0-dff38072366e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.666937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa998e-9c4c-41d4-88e0-dff38072366e None admin] RBAC: Adding query filter params (role.id=a72225466ad54721b9f4cc316efffc55, user.id=ec3334e433d248ab9c103acb60d4f0f4, scope.system=all) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:13.667594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa998e-9c4c-41d4-88e0-dff38072366e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:13.669074 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa998e-9c4c-41d4-88e0-dff38072366e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:13.676203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 154/308] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Jun 4 18:15:13 2022] GET /identity/v3/role_assignments?user.id=ec3334e433d248ab9c103acb60d4f0f4&scope.system=all&role.id=a72225466ad54721b9f4cc316efffc55 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:13.676998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa998e-9c4c-41d4-88e0-dff38072366e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:13.699904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a331c-66b9-40b2-8455-d32ebf647715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:13.701829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a331c-66b9-40b2-8455-d32ebf647715 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.702341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a331c-66b9-40b2-8455-d32ebf647715 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.703209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a331c-66b9-40b2-8455-d32ebf647715 None admin] PATH_INFO: `/v3/groups` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.704226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a331c-66b9-40b2-8455-d32ebf647715 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:13.707114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a331c-66b9-40b2-8455-d32ebf647715 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:13.736305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 155/309] 10.222.0.39 () {60 vars in 1134 bytes} [Sat Jun 4 18:15:13 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:15:13.783558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:13.810807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa998e-9c4c-41d4-88e0-dff38072366e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:13.840829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955fedc-87fb-43ee-9e62-629e4a2ad2f7 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.841200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955fedc-87fb-43ee-9e62-629e4a2ad2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.841397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955fedc-87fb-43ee-9e62-629e4a2ad2f7 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.843234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 156/310] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:15:13.849318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e089f2-605e-4b59-8358-bc1f099f59ea None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.849677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e089f2-605e-4b59-8358-bc1f099f59ea None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.849884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e089f2-605e-4b59-8358-bc1f099f59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.856209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3155f87-9b32-43ca-9949-29f41d335f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:13.858690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155f87-9b32-43ca-9949-29f41d335f81 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:13.859582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155f87-9b32-43ca-9949-29f41d335f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:13.860320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155f87-9b32-43ca-9949-29f41d335f81 None admin] PATH_INFO: `/v3/system/users/121d4fa98059416799aae9f4501861ac/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:13.862652 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3155f87-9b32-43ca-9949-29f41d335f81 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=121d4fa98059416799aae9f4501861ac, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:13.865700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3155f87-9b32-43ca-9949-29f41d335f81 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:13.869358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e4e089f2-605e-4b59-8358-bc1f099f59ea None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:13.871021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e4e089f2-605e-4b59-8358-bc1f099f59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:13.882561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 155/311] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Jun 4 18:15:13 2022] PUT /identity/v3/system/users/121d4fa98059416799aae9f4501861ac/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:13.963060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 157/312] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:13.988194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3155f87-9b32-43ca-9949-29f41d335f81 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:14.102608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3155f87-9b32-43ca-9949-29f41d335f81 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:14.138918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56510520-93fc-4227-8609-9fc7aa8c5677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:14.139759 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56510520-93fc-4227-8609-9fc7aa8c5677 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:14.140069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56510520-93fc-4227-8609-9fc7aa8c5677 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:14.140471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56510520-93fc-4227-8609-9fc7aa8c5677 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:14.151209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56510520-93fc-4227-8609-9fc7aa8c5677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-56510520-93fc-4227-8609-9fc7aa8c5677 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:14.158838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:14.159669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:14.160894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 156/313] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:14.166276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e089f2-605e-4b59-8358-bc1f099f59ea None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:14.262343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:14.272799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e089f2-605e-4b59-8358-bc1f099f59ea None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:14.310714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9168-ef2c-4c27-90e7-acbd17481159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:14.311681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9168-ef2c-4c27-90e7-acbd17481159 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:14.312186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9168-ef2c-4c27-90e7-acbd17481159 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:14.312676 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9168-ef2c-4c27-90e7-acbd17481159 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:14.313640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9168-ef2c-4c27-90e7-acbd17481159 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:14.314134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9168-ef2c-4c27-90e7-acbd17481159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:14.315757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9168-ef2c-4c27-90e7-acbd17481159 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:14.324949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 158/314] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:14.336063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56510520-93fc-4227-8609-9fc7aa8c5677 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:14.342140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:14.445607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56510520-93fc-4227-8609-9fc7aa8c5677 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:14.481206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc74fc-8e4a-4014-b615-4c018c372f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:14.482440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc74fc-8e4a-4014-b615-4c018c372f83 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:14.483066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc74fc-8e4a-4014-b615-4c018c372f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:14.483580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc74fc-8e4a-4014-b615-4c018c372f83 None admin] PATH_INFO: `/v3/users/999085775296440d98c8df6ba835efa2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:14.485044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc74fc-8e4a-4014-b615-4c018c372f83 None admin] RBAC: Authorizing `identity:get_user(user_id=999085775296440d98c8df6ba835efa2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:14.486688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc74fc-8e4a-4014-b615-4c018c372f83 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:14.488538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 157/315] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:14 2022] GET /identity/v3/users/999085775296440d98c8df6ba835efa2 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:14.496921 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9168-ef2c-4c27-90e7-acbd17481159 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:14.601230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9168-ef2c-4c27-90e7-acbd17481159 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:14.635780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dfff0-a45f-46d6-97c2-cc8ea7b10805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:14.636479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dfff0-a45f-46d6-97c2-cc8ea7b10805 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:14.636765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dfff0-a45f-46d6-97c2-cc8ea7b10805 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:14.637046 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dfff0-a45f-46d6-97c2-cc8ea7b10805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:14.662783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:14.706623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dfff0-a45f-46d6-97c2-cc8ea7b10805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:14.708047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dfff0-a45f-46d6-97c2-cc8ea7b10805 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:14.807134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 159/316] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:14.812881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc74fc-8e4a-4014-b615-4c018c372f83 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:14.885015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:14.914767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc74fc-8e4a-4014-b615-4c018c372f83 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:14.951088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34edc2b-ef9e-4eca-8c15-0f907ea9ef32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:14.952404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34edc2b-ef9e-4eca-8c15-0f907ea9ef32 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:14.952899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34edc2b-ef9e-4eca-8c15-0f907ea9ef32 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:14.953362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34edc2b-ef9e-4eca-8c15-0f907ea9ef32 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:14.954748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34edc2b-ef9e-4eca-8c15-0f907ea9ef32 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:14.956436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34edc2b-ef9e-4eca-8c15-0f907ea9ef32 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:14.958715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 158/317] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:14 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:14.964272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dfff0-a45f-46d6-97c2-cc8ea7b10805 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:15.024993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:15.071271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dfff0-a45f-46d6-97c2-cc8ea7b10805 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:15.108165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94280ac-5e6a-45de-8c03-d19b5ce2f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:15.108905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94280ac-5e6a-45de-8c03-d19b5ce2f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:15.109234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94280ac-5e6a-45de-8c03-d19b5ce2f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:15.109517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94280ac-5e6a-45de-8c03-d19b5ce2f2e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:15.110423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94280ac-5e6a-45de-8c03-d19b5ce2f2e1 None admin] RBAC: Adding query filter params (role.id=a72225466ad54721b9f4cc316efffc55, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99, user.id=999085775296440d98c8df6ba835efa2) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:15.110740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94280ac-5e6a-45de-8c03-d19b5ce2f2e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:15.112245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94280ac-5e6a-45de-8c03-d19b5ce2f2e1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:15.119064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 160/318] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:14 2022] GET /identity/v3/role_assignments?user.id=999085775296440d98c8df6ba835efa2&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=a72225466ad54721b9f4cc316efffc55 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:16.107502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f7886-b287-4d19-ae27-78c9b34b188a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.108358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f7886-b287-4d19-ae27-78c9b34b188a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.108358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f7886-b287-4d19-ae27-78c9b34b188a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.109485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 159/319] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:16.110784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36e95d-a32b-4427-9cde-4c095e983aef None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.111173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36e95d-a32b-4427-9cde-4c095e983aef None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.111337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36e95d-a32b-4427-9cde-4c095e983aef None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.112774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 161/320] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:16.114614 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68897921-4f03-4049-ac1b-9a4ae7e13b14 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.114900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68897921-4f03-4049-ac1b-9a4ae7e13b14 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.115177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68897921-4f03-4049-ac1b-9a4ae7e13b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.117843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ee3bf-f18a-45fa-ba8b-9792c0274c50 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.118138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ee3bf-f18a-45fa-ba8b-9792c0274c50 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.118418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ee3bf-f18a-45fa-ba8b-9792c0274c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.132403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-68897921-4f03-4049-ac1b-9a4ae7e13b14 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:16.133588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-68897921-4f03-4049-ac1b-9a4ae7e13b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:16.135636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a59ee3bf-f18a-45fa-ba8b-9792c0274c50 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:16.136854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a59ee3bf-f18a-45fa-ba8b-9792c0274c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:16.204449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 160/321] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:16.205820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecfaa8-aa77-4e31-822f-6e3036732d89 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.206113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecfaa8-aa77-4e31-822f-6e3036732d89 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.206387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecfaa8-aa77-4e31-822f-6e3036732d89 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.206977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 162/322] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:16.207752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 161/323] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:16.213704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8e2e4-ba42-4a43-8b48-67f1d2fa0b7a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.213994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8e2e4-ba42-4a43-8b48-67f1d2fa0b7a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.214268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8e2e4-ba42-4a43-8b48-67f1d2fa0b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.227932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecfaa8-aa77-4e31-822f-6e3036732d89 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:16.232313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b1b8e2e4-ba42-4a43-8b48-67f1d2fa0b7a None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:16.233718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b1b8e2e4-ba42-4a43-8b48-67f1d2fa0b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:16.277622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:16.297542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:16.302920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 163/324] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:16.306111 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8e2e4-ba42-4a43-8b48-67f1d2fa0b7a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:16.333246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecfaa8-aa77-4e31-822f-6e3036732d89 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:16.367623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eccb7-5e92-4db2-8cb5-78ba1cdf51cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:16.368385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eccb7-5e92-4db2-8cb5-78ba1cdf51cd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.368663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eccb7-5e92-4db2-8cb5-78ba1cdf51cd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.368934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824eccb7-5e92-4db2-8cb5-78ba1cdf51cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.370073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eccb7-5e92-4db2-8cb5-78ba1cdf51cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:16.371514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824eccb7-5e92-4db2-8cb5-78ba1cdf51cd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:16.373150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 162/325] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:16.374406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eccb7-5e92-4db2-8cb5-78ba1cdf51cd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:16.407818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8e2e4-ba42-4a43-8b48-67f1d2fa0b7a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:16.443080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9170b-9809-43cb-ace3-01e27074e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:16.443895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9170b-9809-43cb-ace3-01e27074e2bb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.444213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9170b-9809-43cb-ace3-01e27074e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.444498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9170b-9809-43cb-ace3-01e27074e2bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.455863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9170b-9809-43cb-ace3-01e27074e2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-bca9170b-9809-43cb-ace3-01e27074e2bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:16.463525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:16.464481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:16.465245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 164/326] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:16.465882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9170b-9809-43cb-ace3-01e27074e2bb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:16.473227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824eccb7-5e92-4db2-8cb5-78ba1cdf51cd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:16.506071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:16.506238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0578490-1b3f-446c-b1eb-53c60739e206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:16.507005 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0578490-1b3f-446c-b1eb-53c60739e206 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.507275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0578490-1b3f-446c-b1eb-53c60739e206 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.507607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0578490-1b3f-446c-b1eb-53c60739e206 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.514527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:16.519425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0578490-1b3f-446c-b1eb-53c60739e206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d0578490-1b3f-446c-b1eb-53c60739e206 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:16.527221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:16.528180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:16.529123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 163/327] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:16.529955 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0578490-1b3f-446c-b1eb-53c60739e206 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:16.568557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9170b-9809-43cb-ace3-01e27074e2bb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:16.600633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a3e63-2915-4a4e-96c5-c4bfbf14ae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:16.601297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a3e63-2915-4a4e-96c5-c4bfbf14ae0e None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.601576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a3e63-2915-4a4e-96c5-c4bfbf14ae0e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.601839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a3e63-2915-4a4e-96c5-c4bfbf14ae0e None admin] PATH_INFO: `/v3/groups` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.602519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a3e63-2915-4a4e-96c5-c4bfbf14ae0e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:16.603984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a3e63-2915-4a4e-96c5-c4bfbf14ae0e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:16.619176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 165/328] 10.222.0.39 () {60 vars in 1134 bytes} [Sat Jun 4 18:15:16 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:15:16.619923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a3e63-2915-4a4e-96c5-c4bfbf14ae0e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:16.638796 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0578490-1b3f-446c-b1eb-53c60739e206 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:16.681877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b74e1-949c-4181-bbc7-9030c937bc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:16.682578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b74e1-949c-4181-bbc7-9030c937bc8a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.683021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b74e1-949c-4181-bbc7-9030c937bc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.683304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b74e1-949c-4181-bbc7-9030c937bc8a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.684227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b74e1-949c-4181-bbc7-9030c937bc8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:16.684541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b74e1-949c-4181-bbc7-9030c937bc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:16.686041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b74e1-949c-4181-bbc7-9030c937bc8a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:16.700679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 164/329] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:16.701940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b74e1-949c-4181-bbc7-9030c937bc8a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:16.737203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:16.740433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a3e63-2915-4a4e-96c5-c4bfbf14ae0e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:16.773189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:16.784620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f9ee2-b8f2-4580-879d-8f5de425c899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:16.785485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9ee2-b8f2-4580-879d-8f5de425c899 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.786628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9ee2-b8f2-4580-879d-8f5de425c899 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.786939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f9ee2-b8f2-4580-879d-8f5de425c899 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.787744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f9ee2-b8f2-4580-879d-8f5de425c899 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:16.788107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f9ee2-b8f2-4580-879d-8f5de425c899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:16.789520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f9ee2-b8f2-4580-879d-8f5de425c899 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:16.805850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 166/330] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:16.807023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f9ee2-b8f2-4580-879d-8f5de425c899 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:16.820079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b74e1-949c-4181-bbc7-9030c937bc8a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:16.860399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb561e2-f943-491e-8876-18251c38a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:16.861290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb561e2-f943-491e-8876-18251c38a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.861575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb561e2-f943-491e-8876-18251c38a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.861855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb561e2-f943-491e-8876-18251c38a6a5 None admin] PATH_INFO: `/v3/users/ec3334e433d248ab9c103acb60d4f0f4` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.863602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb561e2-f943-491e-8876-18251c38a6a5 None admin] RBAC: Authorizing `identity:get_user(user_id=ec3334e433d248ab9c103acb60d4f0f4)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:16.864534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb561e2-f943-491e-8876-18251c38a6a5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:16.866455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 165/331] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:16 2022] GET /identity/v3/users/ec3334e433d248ab9c103acb60d4f0f4 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:16.871932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb561e2-f943-491e-8876-18251c38a6a5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:16.924420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f9ee2-b8f2-4580-879d-8f5de425c899 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:16.970320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351db31a-15c4-42dd-9307-e41ca1aed51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:16.971745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351db31a-15c4-42dd-9307-e41ca1aed51e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:16.972069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351db31a-15c4-42dd-9307-e41ca1aed51e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:16.972833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351db31a-15c4-42dd-9307-e41ca1aed51e None admin] PATH_INFO: `/v3/users/121d4fa98059416799aae9f4501861ac` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:16.974093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351db31a-15c4-42dd-9307-e41ca1aed51e None admin] RBAC: Authorizing `identity:get_user(user_id=121d4fa98059416799aae9f4501861ac)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:16.976313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351db31a-15c4-42dd-9307-e41ca1aed51e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:16.978872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 167/332] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:16 2022] GET /identity/v3/users/121d4fa98059416799aae9f4501861ac => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:16.985724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb561e2-f943-491e-8876-18251c38a6a5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:16.985886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351db31a-15c4-42dd-9307-e41ca1aed51e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:17.020150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:17.030839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:17.038535 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139d82-7d59-4192-80ac-f039b378171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:17.039715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139d82-7d59-4192-80ac-f039b378171b None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:17.040252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139d82-7d59-4192-80ac-f039b378171b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:17.040727 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139d82-7d59-4192-80ac-f039b378171b None admin] PATH_INFO: `/v3/system/users/ec3334e433d248ab9c103acb60d4f0f4/roles/a72225466ad54721b9f4cc316efffc55` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:17.042792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f139d82-7d59-4192-80ac-f039b378171b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ec3334e433d248ab9c103acb60d4f0f4, role_id=a72225466ad54721b9f4cc316efffc55)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:17.044488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f139d82-7d59-4192-80ac-f039b378171b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:17.056401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 166/333] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Jun 4 18:15:16 2022] PUT /identity/v3/system/users/ec3334e433d248ab9c103acb60d4f0f4/roles/a72225466ad54721b9f4cc316efffc55 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:15:17.132995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351db31a-15c4-42dd-9307-e41ca1aed51e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:17.176668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a30e3e-1ba9-4f69-bb96-c34d46461caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:17.177360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30e3e-1ba9-4f69-bb96-c34d46461caf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:17.177644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30e3e-1ba9-4f69-bb96-c34d46461caf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:17.177923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a30e3e-1ba9-4f69-bb96-c34d46461caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:17.178786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a30e3e-1ba9-4f69-bb96-c34d46461caf None admin] RBAC: Adding query filter params (role.id=e0e319e010e342d184a4b77ac79ecf84, user.id=121d4fa98059416799aae9f4501861ac, scope.system=all) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:17.179099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a30e3e-1ba9-4f69-bb96-c34d46461caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:17.181002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a30e3e-1ba9-4f69-bb96-c34d46461caf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:17.195903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 168/334] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Jun 4 18:15:16 2022] GET /identity/v3/role_assignments?user.id=121d4fa98059416799aae9f4501861ac&scope.system=all&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:19.087057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcc47b-6f7d-48f3-92db-a84c27026595 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:19.087699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcc47b-6f7d-48f3-92db-a84c27026595 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:19.087699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcc47b-6f7d-48f3-92db-a84c27026595 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:19.089089 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 167/335] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:19.095922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc739201-dd05-40ad-b540-e130e6dc220d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:19.096428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc739201-dd05-40ad-b540-e130e6dc220d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:19.096509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc739201-dd05-40ad-b540-e130e6dc220d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:19.124857 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bc739201-dd05-40ad-b540-e130e6dc220d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:19.126074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bc739201-dd05-40ad-b540-e130e6dc220d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:19.211176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 169/336] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:19.253462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcc47b-6f7d-48f3-92db-a84c27026595 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:19.411440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcc47b-6f7d-48f3-92db-a84c27026595 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:19.459490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259efc59-e532-4d0a-b649-f2b2bcdcd566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:19.460344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259efc59-e532-4d0a-b649-f2b2bcdcd566 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:19.460621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259efc59-e532-4d0a-b649-f2b2bcdcd566 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:19.460891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259efc59-e532-4d0a-b649-f2b2bcdcd566 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:19.477394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259efc59-e532-4d0a-b649-f2b2bcdcd566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-259efc59-e532-4d0a-b649-f2b2bcdcd566 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:19.485146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:19.486061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:19.486849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 168/337] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:19.492349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc739201-dd05-40ad-b540-e130e6dc220d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:19.532759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:19.644819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00489525-16f7-4ecf-b66f-e6363d9acb3f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:19.645271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00489525-16f7-4ecf-b66f-e6363d9acb3f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:19.645555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00489525-16f7-4ecf-b66f-e6363d9acb3f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:19.646929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 169/338] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:15:19.653880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc739201-dd05-40ad-b540-e130e6dc220d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:19.666502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cbcf2-ef9e-46eb-bfd6-9df136cf396f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:19.667442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cbcf2-ef9e-46eb-bfd6-9df136cf396f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:19.667944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cbcf2-ef9e-46eb-bfd6-9df136cf396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:19.699469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed24766-db1c-4f88-851f-cd6ef53079b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:19.700176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed24766-db1c-4f88-851f-cd6ef53079b2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:19.700462 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed24766-db1c-4f88-851f-cd6ef53079b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:19.700733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed24766-db1c-4f88-851f-cd6ef53079b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:19.701465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1d2cbcf2-ef9e-46eb-bfd6-9df136cf396f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:19.701674 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed24766-db1c-4f88-851f-cd6ef53079b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:19.701928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed24766-db1c-4f88-851f-cd6ef53079b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:19.703337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed24766-db1c-4f88-851f-cd6ef53079b2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:19.703608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1d2cbcf2-ef9e-46eb-bfd6-9df136cf396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:19.717292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 170/339] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:19.722555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed24766-db1c-4f88-851f-cd6ef53079b2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:19.786803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:19.818516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 170/340] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:19.852417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:19.853297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cbcf2-ef9e-46eb-bfd6-9df136cf396f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:19.875850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed24766-db1c-4f88-851f-cd6ef53079b2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:19.919934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d3248-29eb-4449-91d1-dc3c8ee57719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:19.921268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3248-29eb-4449-91d1-dc3c8ee57719 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:19.921681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3248-29eb-4449-91d1-dc3c8ee57719 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:19.922093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3248-29eb-4449-91d1-dc3c8ee57719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:19.985203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cbcf2-ef9e-46eb-bfd6-9df136cf396f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:20.023719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d3248-29eb-4449-91d1-dc3c8ee57719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:20.025935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d3248-29eb-4449-91d1-dc3c8ee57719 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:20.029190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0221b63-ac63-4128-a7f6-2531492f20cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:20.030537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221b63-ac63-4128-a7f6-2531492f20cc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:20.031119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221b63-ac63-4128-a7f6-2531492f20cc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:20.031589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0221b63-ac63-4128-a7f6-2531492f20cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:20.051369 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0221b63-ac63-4128-a7f6-2531492f20cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e0221b63-ac63-4128-a7f6-2531492f20cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:20.065548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:20.066465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:20.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:20.072589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 171/341] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:15:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:20.079289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0221b63-ac63-4128-a7f6-2531492f20cc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:20.166260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:20.218978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:20.222580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 171/342] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 18:15:20.226132 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d3248-29eb-4449-91d1-dc3c8ee57719 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:20.235749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0221b63-ac63-4128-a7f6-2531492f20cc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:20.284734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c59bc-d9db-4f12-907e-4607e2c07349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:20.285813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c59bc-d9db-4f12-907e-4607e2c07349 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:20.286300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c59bc-d9db-4f12-907e-4607e2c07349 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:20.286777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c59bc-d9db-4f12-907e-4607e2c07349 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:20.287741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c59bc-d9db-4f12-907e-4607e2c07349 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:20.288278 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c59bc-d9db-4f12-907e-4607e2c07349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:20.289896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c59bc-d9db-4f12-907e-4607e2c07349 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:20.300469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 172/343] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:20.302119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637bfd-37e7-4a14-a3a0-4d505f907cce None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:20.302645 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637bfd-37e7-4a14-a3a0-4d505f907cce None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:20.303119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637bfd-37e7-4a14-a3a0-4d505f907cce None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:20.304592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 173/344] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:20.317498 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9c56c-6849-4140-a660-95d83961b872 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:20.317786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9c56c-6849-4140-a660-95d83961b872 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:20.318064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9c56c-6849-4140-a660-95d83961b872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:20.341519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e2c9c56c-6849-4140-a660-95d83961b872 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:20.343561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e2c9c56c-6849-4140-a660-95d83961b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:20.410182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d3248-29eb-4449-91d1-dc3c8ee57719 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:20.430025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 174/345] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:20.431133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9c56c-6849-4140-a660-95d83961b872 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:20.470319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:20.495694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4423-7dfb-48c6-beeb-77561333c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:20.500373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4423-7dfb-48c6-beeb-77561333c793 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:20.500827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4423-7dfb-48c6-beeb-77561333c793 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:20.501260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c4423-7dfb-48c6-beeb-77561333c793 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:20.503369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c4423-7dfb-48c6-beeb-77561333c793 None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:20.505237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c4423-7dfb-48c6-beeb-77561333c793 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:20.507516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 172/346] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:20 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:20.508554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4423-7dfb-48c6-beeb-77561333c793 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:20.569169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9c56c-6849-4140-a660-95d83961b872 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:20.585490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:20.609394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13291bb3-4728-46b9-9abe-e1b989769f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:20.610452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291bb3-4728-46b9-9abe-e1b989769f0b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:20.611005 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291bb3-4728-46b9-9abe-e1b989769f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:20.611478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291bb3-4728-46b9-9abe-e1b989769f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:20.653274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c4423-7dfb-48c6-beeb-77561333c793 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:20.699730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13291bb3-4728-46b9-9abe-e1b989769f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:20.699922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdbbfb-2c63-48c0-81f2-71fafd614488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:20.700704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdbbfb-2c63-48c0-81f2-71fafd614488 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:20.700984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdbbfb-2c63-48c0-81f2-71fafd614488 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:20.701259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdbbfb-2c63-48c0-81f2-71fafd614488 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:20.702528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13291bb3-4728-46b9-9abe-e1b989769f0b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:20.715590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdbbfb-2c63-48c0-81f2-71fafd614488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c6cdbbfb-2c63-48c0-81f2-71fafd614488 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:20.726965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:20.728075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:20.729068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:20.731705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 173/347] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:20.733890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68469aa-4814-439c-a470-2cfab1e4b2c1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:20.734336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68469aa-4814-439c-a470-2cfab1e4b2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:20.734787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68469aa-4814-439c-a470-2cfab1e4b2c1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:20.736457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 174/348] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:20.737480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68469aa-4814-439c-a470-2cfab1e4b2c1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:20.753155 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:20.852811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 175/349] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:20.854443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7b0dc-5629-4498-943a-75067d26a9ba None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:20.854857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7b0dc-5629-4498-943a-75067d26a9ba None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:20.855265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7b0dc-5629-4498-943a-75067d26a9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:20.880741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68469aa-4814-439c-a470-2cfab1e4b2c1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:20.884984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7ce7b0dc-5629-4498-943a-75067d26a9ba None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:20.887216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7ce7b0dc-5629-4498-943a-75067d26a9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:20.895929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:20.933108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba47fcd-22d6-489c-b314-8697482b7807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:20.934924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba47fcd-22d6-489c-b314-8697482b7807 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:20.935244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba47fcd-22d6-489c-b314-8697482b7807 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:20.935518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba47fcd-22d6-489c-b314-8697482b7807 None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:20.943931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba47fcd-22d6-489c-b314-8697482b7807 None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:20.946189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba47fcd-22d6-489c-b314-8697482b7807 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:20.949682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 175/350] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:20 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:20.950776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba47fcd-22d6-489c-b314-8697482b7807 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:20.986314 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 176/351] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:20.987766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7b0dc-5629-4498-943a-75067d26a9ba None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:21.065729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:21.102636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba47fcd-22d6-489c-b314-8697482b7807 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:21.119333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7b0dc-5629-4498-943a-75067d26a9ba None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:21.142767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5811e7d-1668-4276-a3f6-b79b8192316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:21.143860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5811e7d-1668-4276-a3f6-b79b8192316a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.144356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5811e7d-1668-4276-a3f6-b79b8192316a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.144815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5811e7d-1668-4276-a3f6-b79b8192316a None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.145764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5811e7d-1668-4276-a3f6-b79b8192316a None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:21.146275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5811e7d-1668-4276-a3f6-b79b8192316a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:21.147973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5811e7d-1668-4276-a3f6-b79b8192316a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:21.159343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 176/352] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:21.164534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5811e7d-1668-4276-a3f6-b79b8192316a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:21.168457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247ceea-ba4a-4fe7-8b15-df8e295248f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:21.169337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ceea-ba4a-4fe7-8b15-df8e295248f2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.169620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ceea-ba4a-4fe7-8b15-df8e295248f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.169882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ceea-ba4a-4fe7-8b15-df8e295248f2 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.174834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247ceea-ba4a-4fe7-8b15-df8e295248f2 None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:21.176359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247ceea-ba4a-4fe7-8b15-df8e295248f2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:21.178463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 177/353] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:20 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:21.179235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247ceea-ba4a-4fe7-8b15-df8e295248f2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:21.217191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:21.308498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5811e7d-1668-4276-a3f6-b79b8192316a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:21.318560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247ceea-ba4a-4fe7-8b15-df8e295248f2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:21.356560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be1d79-1572-42a7-a74a-799fbc2210c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:21.357235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be1d79-1572-42a7-a74a-799fbc2210c3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.357518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be1d79-1572-42a7-a74a-799fbc2210c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.357937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be1d79-1572-42a7-a74a-799fbc2210c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.359378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be1d79-1572-42a7-a74a-799fbc2210c3 None admin] RBAC: Adding query filter params (group.id=e019af2c2ae2496e809e80bd14fd6491, role.id=e0e319e010e342d184a4b77ac79ecf84, scope.project.id=519eba4a80c44012af4aed921a30d31b) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:21.359700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be1d79-1572-42a7-a74a-799fbc2210c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:21.363102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:21.363220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be1d79-1572-42a7-a74a-799fbc2210c3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:21.367915 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 177/354] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 4 18:15:21 2022] GET /identity/v3/role_assignments?group.id=e019af2c2ae2496e809e80bd14fd6491&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:21.368801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be1d79-1572-42a7-a74a-799fbc2210c3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:21.371727 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f74806-a181-4173-97cb-1575d720b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:21.372923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74806-a181-4173-97cb-1575d720b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.373454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74806-a181-4173-97cb-1575d720b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.374025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74806-a181-4173-97cb-1575d720b0e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.388307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f74806-a181-4173-97cb-1575d720b0e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-80f74806-a181-4173-97cb-1575d720b0e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:21.397390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:21.398563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 18:15:21.399571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:21.401561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 178/355] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:21.402403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f74806-a181-4173-97cb-1575d720b0e4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:21.499396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:21.505451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be1d79-1572-42a7-a74a-799fbc2210c3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:21.531198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f74806-a181-4173-97cb-1575d720b0e4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:21.545062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061d7f3-51e7-42e4-b5ff-7bf797fa07b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:21.546208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061d7f3-51e7-42e4-b5ff-7bf797fa07b8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.546696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061d7f3-51e7-42e4-b5ff-7bf797fa07b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.547176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061d7f3-51e7-42e4-b5ff-7bf797fa07b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.570958 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fae5a9-9458-4210-a148-9bf49f36d09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:21.571772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae5a9-9458-4210-a148-9bf49f36d09c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.572073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae5a9-9458-4210-a148-9bf49f36d09c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.572352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae5a9-9458-4210-a148-9bf49f36d09c None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.573595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fae5a9-9458-4210-a148-9bf49f36d09c None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:21.575078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fae5a9-9458-4210-a148-9bf49f36d09c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:21.576982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 179/356] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:21 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:21.579047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935f9d8-b158-4e2d-9690-424cdba5d6ed None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.579499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935f9d8-b158-4e2d-9690-424cdba5d6ed None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.579921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935f9d8-b158-4e2d-9690-424cdba5d6ed None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.581491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 180/357] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:21.582379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935f9d8-b158-4e2d-9690-424cdba5d6ed None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:21.633949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061d7f3-51e7-42e4-b5ff-7bf797fa07b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:21.635877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061d7f3-51e7-42e4-b5ff-7bf797fa07b8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:21.652538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:21.699948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935f9d8-b158-4e2d-9690-424cdba5d6ed None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:21.739951 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93b3a7-a1ee-4012-bbf6-361931ae7779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:21.740646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93b3a7-a1ee-4012-bbf6-361931ae7779 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.740928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93b3a7-a1ee-4012-bbf6-361931ae7779 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.741199 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93b3a7-a1ee-4012-bbf6-361931ae7779 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.741938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93b3a7-a1ee-4012-bbf6-361931ae7779 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:21.742236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93b3a7-a1ee-4012-bbf6-361931ae7779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:21.743610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93b3a7-a1ee-4012-bbf6-361931ae7779 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:21.755036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 181/358] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:21.756861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93b3a7-a1ee-4012-bbf6-361931ae7779 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:21.762277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:21.769835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 178/359] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:21.771430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9ff01-4684-4e6e-8956-593a48bfba8d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.771547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9ff01-4684-4e6e-8956-593a48bfba8d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.771791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9ff01-4684-4e6e-8956-593a48bfba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.792982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b0c9ff01-4684-4e6e-8956-593a48bfba8d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:21.794178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b0c9ff01-4684-4e6e-8956-593a48bfba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:21.878612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 179/360] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:21.879847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049bbd-2413-4a49-bc2b-dc9de2fd3c5d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.880960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049bbd-2413-4a49-bc2b-dc9de2fd3c5d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.881244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049bbd-2413-4a49-bc2b-dc9de2fd3c5d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.882805 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 180/361] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:21.883517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049bbd-2413-4a49-bc2b-dc9de2fd3c5d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:21.884321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93b3a7-a1ee-4012-bbf6-361931ae7779 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:21.910308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:21.926917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52bcd-7893-4784-8adc-050b4ecb39eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:21.927617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52bcd-7893-4784-8adc-050b4ecb39eb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:21.927989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52bcd-7893-4784-8adc-050b4ecb39eb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:21.928361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed52bcd-7893-4784-8adc-050b4ecb39eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:21.929214 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed52bcd-7893-4784-8adc-050b4ecb39eb None admin] RBAC: Adding query filter params (group.id=e019af2c2ae2496e809e80bd14fd6491, role.id=f75ffcd78e8b4fb8a4942efdd54e431f, scope.project.id=519eba4a80c44012af4aed921a30d31b) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:21.929615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed52bcd-7893-4784-8adc-050b4ecb39eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:21.930985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed52bcd-7893-4784-8adc-050b4ecb39eb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:21.939426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 182/362] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 4 18:15:21 2022] GET /identity/v3/role_assignments?group.id=e019af2c2ae2496e809e80bd14fd6491&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=f75ffcd78e8b4fb8a4942efdd54e431f => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:21.940994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52bcd-7893-4784-8adc-050b4ecb39eb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:22.034348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049bbd-2413-4a49-bc2b-dc9de2fd3c5d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:22.067603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed52bcd-7893-4784-8adc-050b4ecb39eb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:22.080246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:22.099325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d80f37-d6b4-4aa3-9605-0ea5aa11ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:22.101434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d80f37-d6b4-4aa3-9605-0ea5aa11ad66 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:22.101916 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d80f37-d6b4-4aa3-9605-0ea5aa11ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:22.102361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d80f37-d6b4-4aa3-9605-0ea5aa11ad66 None admin] PATH_INFO: `/v3/users/ec3334e433d248ab9c103acb60d4f0f4` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:22.104808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d80f37-d6b4-4aa3-9605-0ea5aa11ad66 None admin] RBAC: Authorizing `identity:get_user(user_id=ec3334e433d248ab9c103acb60d4f0f4)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:22.107195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d80f37-d6b4-4aa3-9605-0ea5aa11ad66 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:22.116078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 181/363] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:15:21 2022] GET /identity/v3/users/ec3334e433d248ab9c103acb60d4f0f4 => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:22.116078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce20ac2-832c-4fa2-be9b-d605e1f31700 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:22.116078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce20ac2-832c-4fa2-be9b-d605e1f31700 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:22.116078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce20ac2-832c-4fa2-be9b-d605e1f31700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:22.120405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd154501-ca6b-46c7-9aca-d12492dc67c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:22.120405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd154501-ca6b-46c7-9aca-d12492dc67c7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:22.120405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd154501-ca6b-46c7-9aca-d12492dc67c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:22.120405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd154501-ca6b-46c7-9aca-d12492dc67c7 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:22.121444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd154501-ca6b-46c7-9aca-d12492dc67c7 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:22.123004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd154501-ca6b-46c7-9aca-d12492dc67c7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:22.125144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 183/364] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:21 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:22.126008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd154501-ca6b-46c7-9aca-d12492dc67c7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:22.143327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3ce20ac2-832c-4fa2-be9b-d605e1f31700 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:22.145648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3ce20ac2-832c-4fa2-be9b-d605e1f31700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:22.205653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:22.240877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 182/365] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:22.241738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce20ac2-832c-4fa2-be9b-d605e1f31700 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:22.259274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd154501-ca6b-46c7-9aca-d12492dc67c7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:22.303289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3c04-6f37-41da-a899-f40b14384410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:22.304737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3c04-6f37-41da-a899-f40b14384410 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:22.305246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3c04-6f37-41da-a899-f40b14384410 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:22.305718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3c04-6f37-41da-a899-f40b14384410 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:22.324039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d3c04-6f37-41da-a899-f40b14384410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f20d3c04-6f37-41da-a899-f40b14384410 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:22.335091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:22.336032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:22.336826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 184/366] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:15:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:22.337463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3c04-6f37-41da-a899-f40b14384410 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:22.381795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce20ac2-832c-4fa2-be9b-d605e1f31700 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:22.409965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:22.420891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfe41f-c6a4-4795-be14-909a8fb0dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:22.422098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfe41f-c6a4-4795-be14-909a8fb0dee7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:22.422599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfe41f-c6a4-4795-be14-909a8fb0dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:22.423066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfe41f-c6a4-4795-be14-909a8fb0dee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:22.424412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfe41f-c6a4-4795-be14-909a8fb0dee7 None admin] RBAC: Adding query filter params (role.id=a72225466ad54721b9f4cc316efffc55, user.id=ec3334e433d248ab9c103acb60d4f0f4, scope.system=all) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:22.424959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfe41f-c6a4-4795-be14-909a8fb0dee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:22.426640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfe41f-c6a4-4795-be14-909a8fb0dee7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:22.440250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 183/367] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Jun 4 18:15:22 2022] GET /identity/v3/role_assignments?user.id=ec3334e433d248ab9c103acb60d4f0f4&scope.system=all&role.id=a72225466ad54721b9f4cc316efffc55 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:22.441344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfe41f-c6a4-4795-be14-909a8fb0dee7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:22.457454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3c04-6f37-41da-a899-f40b14384410 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:22.484259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:22.536907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67223866-7d13-49b5-8e32-f9cf1e2fee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:22.537710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67223866-7d13-49b5-8e32-f9cf1e2fee6a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:22.538004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67223866-7d13-49b5-8e32-f9cf1e2fee6a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:22.538285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67223866-7d13-49b5-8e32-f9cf1e2fee6a None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:22.539574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67223866-7d13-49b5-8e32-f9cf1e2fee6a None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:22.541090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67223866-7d13-49b5-8e32-f9cf1e2fee6a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:22.543329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 185/368] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:22 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:22.548518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67223866-7d13-49b5-8e32-f9cf1e2fee6a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:22.556039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfe41f-c6a4-4795-be14-909a8fb0dee7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:22.596268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1382b83-0164-4528-b72c-735e3a0c1ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:22.597633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1382b83-0164-4528-b72c-735e3a0c1ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:22.598284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1382b83-0164-4528-b72c-735e3a0c1ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:22.599150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1382b83-0164-4528-b72c-735e3a0c1ce3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:22.614086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1382b83-0164-4528-b72c-735e3a0c1ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a1382b83-0164-4528-b72c-735e3a0c1ce3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:22.625995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:22.626979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:22.627763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:22.630495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 184/369] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:22.631565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1382b83-0164-4528-b72c-735e3a0c1ce3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:22.695500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:22.755987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67223866-7d13-49b5-8e32-f9cf1e2fee6a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:22.759285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1382b83-0164-4528-b72c-735e3a0c1ce3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:22.798308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594830f-3f34-4893-a2e3-713ab00afbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:22.799275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab868a-3acb-4437-be0d-c580cb7bb6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:22.800241 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594830f-3f34-4893-a2e3-713ab00afbaa None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:22.801129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab868a-3acb-4437-be0d-c580cb7bb6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:22.801606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab868a-3acb-4437-be0d-c580cb7bb6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:22.801897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594830f-3f34-4893-a2e3-713ab00afbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:22.802191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594830f-3f34-4893-a2e3-713ab00afbaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:22.802509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab868a-3acb-4437-be0d-c580cb7bb6f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:22.803078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594830f-3f34-4893-a2e3-713ab00afbaa None admin] RBAC: Adding query filter params (group.id=e019af2c2ae2496e809e80bd14fd6491, role.id=e0e319e010e342d184a4b77ac79ecf84, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:22.803406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594830f-3f34-4893-a2e3-713ab00afbaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:22.803881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab868a-3acb-4437-be0d-c580cb7bb6f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:22.804468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab868a-3acb-4437-be0d-c580cb7bb6f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:22.804950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594830f-3f34-4893-a2e3-713ab00afbaa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:22.806324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab868a-3acb-4437-be0d-c580cb7bb6f8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:22.817327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 185/370] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 4 18:15:22 2022] GET /identity/v3/role_assignments?group.id=e019af2c2ae2496e809e80bd14fd6491&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:22.818417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 186/371] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:22.823541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594830f-3f34-4893-a2e3-713ab00afbaa None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:22.824208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab868a-3acb-4437-be0d-c580cb7bb6f8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:22.946404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:22.985720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594830f-3f34-4893-a2e3-713ab00afbaa None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:23.009373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:23.046443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4598ce-cdb0-4aa0-bbde-e1bf20a0b8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:23.048864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab868a-3acb-4437-be0d-c580cb7bb6f8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:23.050662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4598ce-cdb0-4aa0-bbde-e1bf20a0b8ef None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:23.050983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4598ce-cdb0-4aa0-bbde-e1bf20a0b8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:23.051266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4598ce-cdb0-4aa0-bbde-e1bf20a0b8ef None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:23.052093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4598ce-cdb0-4aa0-bbde-e1bf20a0b8ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:23.052408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4598ce-cdb0-4aa0-bbde-e1bf20a0b8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:23.053887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4598ce-cdb0-4aa0-bbde-e1bf20a0b8ef None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:23.072677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 186/372] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:23.077827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4598ce-cdb0-4aa0-bbde-e1bf20a0b8ef None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:23.109313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569f881-5de5-4734-90e0-64933766973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:23.109972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f881-5de5-4734-90e0-64933766973f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:23.110250 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f881-5de5-4734-90e0-64933766973f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:23.110523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569f881-5de5-4734-90e0-64933766973f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:23.217409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569f881-5de5-4734-90e0-64933766973f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:23.219798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569f881-5de5-4734-90e0-64933766973f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:23.243903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4598ce-cdb0-4aa0-bbde-e1bf20a0b8ef None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:23.313339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10ad7-f231-4168-9659-32e806187516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:23.314889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10ad7-f231-4168-9659-32e806187516 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:23.315348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10ad7-f231-4168-9659-32e806187516 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:23.315807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10ad7-f231-4168-9659-32e806187516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:23.317811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:23.368982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:23.406626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec10ad7-f231-4168-9659-32e806187516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:23.408165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec10ad7-f231-4168-9659-32e806187516 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:23.499066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 187/373] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 18:15:23.505013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569f881-5de5-4734-90e0-64933766973f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:23.521551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 187/374] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 18:15:23.527519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10ad7-f231-4168-9659-32e806187516 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:23.603249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:23.633186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10ad7-f231-4168-9659-32e806187516 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:23.676756 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cde062-0749-425d-a0c6-801f5d9f20b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:23.677931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cde062-0749-425d-a0c6-801f5d9f20b3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:23.678360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cde062-0749-425d-a0c6-801f5d9f20b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:23.678872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cde062-0749-425d-a0c6-801f5d9f20b3 None admin] PATH_INFO: `/v3/projects/b474e20b865e43bf8fbbb839d2f225c5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:23.680312 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cde062-0749-425d-a0c6-801f5d9f20b3 None admin] RBAC: Authorizing `identity:get_project(project_id=b474e20b865e43bf8fbbb839d2f225c5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:23.681944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cde062-0749-425d-a0c6-801f5d9f20b3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:23.683840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 188/375] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:23 2022] GET /identity/v3/projects/b474e20b865e43bf8fbbb839d2f225c5 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:23.694826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cde062-0749-425d-a0c6-801f5d9f20b3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:23.726244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569f881-5de5-4734-90e0-64933766973f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:23.771404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0352f83-9d54-4416-8a7f-64032848baf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:23.772720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352f83-9d54-4416-8a7f-64032848baf3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:23.773154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352f83-9d54-4416-8a7f-64032848baf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:23.773593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352f83-9d54-4416-8a7f-64032848baf3 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:23.775676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0352f83-9d54-4416-8a7f-64032848baf3 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:23.777703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0352f83-9d54-4416-8a7f-64032848baf3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:23.780921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 188/376] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:23 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:23.789726 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0352f83-9d54-4416-8a7f-64032848baf3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:23.818272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:23.926893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cde062-0749-425d-a0c6-801f5d9f20b3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:23.955732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0352f83-9d54-4416-8a7f-64032848baf3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:23.974028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6ae06-8c13-4bbe-86bb-2292ea6b2073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:23.975245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6ae06-8c13-4bbe-86bb-2292ea6b2073 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:23.975700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6ae06-8c13-4bbe-86bb-2292ea6b2073 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:23.976212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6ae06-8c13-4bbe-86bb-2292ea6b2073 None admin] PATH_INFO: `/v3/groups/db763078253e4411990fec14fa8c54fc` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:23.981751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6ae06-8c13-4bbe-86bb-2292ea6b2073 None admin] RBAC: Authorizing `identity:get_group(group_id=db763078253e4411990fec14fa8c54fc)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:23.983719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6ae06-8c13-4bbe-86bb-2292ea6b2073 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:23.985970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 189/377] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:23 2022] GET /identity/v3/groups/db763078253e4411990fec14fa8c54fc => generated 229 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:23.991730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6ae06-8c13-4bbe-86bb-2292ea6b2073 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:23.994753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:24.045505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aababb-05fe-4ef3-b286-720c33876abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:24.046480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aababb-05fe-4ef3-b286-720c33876abd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:24.046685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aababb-05fe-4ef3-b286-720c33876abd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:24.046962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aababb-05fe-4ef3-b286-720c33876abd None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:24.048232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aababb-05fe-4ef3-b286-720c33876abd None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:24.049701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aababb-05fe-4ef3-b286-720c33876abd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:24.051818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 189/378] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:23 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:24.057395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aababb-05fe-4ef3-b286-720c33876abd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:24.120950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6ae06-8c13-4bbe-86bb-2292ea6b2073 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:24.180240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53b74e-ebe1-434e-90ff-128499d7b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:24.180917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53b74e-ebe1-434e-90ff-128499d7b97a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:24.181195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53b74e-ebe1-434e-90ff-128499d7b97a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:24.182796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53b74e-ebe1-434e-90ff-128499d7b97a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:24.183648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53b74e-ebe1-434e-90ff-128499d7b97a None admin] RBAC: Adding query filter params (group.id=db763078253e4411990fec14fa8c54fc, role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=b474e20b865e43bf8fbbb839d2f225c5) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:24.183960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53b74e-ebe1-434e-90ff-128499d7b97a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:24.186641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53b74e-ebe1-434e-90ff-128499d7b97a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:24.200106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 190/379] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 4 18:15:23 2022] GET /identity/v3/role_assignments?group.id=db763078253e4411990fec14fa8c54fc&scope.project.id=b474e20b865e43bf8fbbb839d2f225c5&role.id=9f557e97d94b4b499a6765419452e1ef => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:24.201978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fece4e-2e2d-40b1-bf4f-c78f99e5fc43 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:24.202267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fece4e-2e2d-40b1-bf4f-c78f99e5fc43 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:24.202521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fece4e-2e2d-40b1-bf4f-c78f99e5fc43 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:24.204341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 191/380] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:24.217437 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46d0f-e476-4494-9744-7318f2b2af4d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:24.217759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46d0f-e476-4494-9744-7318f2b2af4d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:24.218028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f46d0f-e476-4494-9744-7318f2b2af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:24.223045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:24.244843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f1f46d0f-e476-4494-9744-7318f2b2af4d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:24.246297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f1f46d0f-e476-4494-9744-7318f2b2af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:24.255082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aababb-05fe-4ef3-b286-720c33876abd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:24.312943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ce1fb-0d49-4e86-85ca-e1f6073935ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:24.313648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ce1fb-0d49-4e86-85ca-e1f6073935ca None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:24.313936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ce1fb-0d49-4e86-85ca-e1f6073935ca None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:24.314215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ce1fb-0d49-4e86-85ca-e1f6073935ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:24.315071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ce1fb-0d49-4e86-85ca-e1f6073935ca None admin] RBAC: Adding query filter params (group.id=e019af2c2ae2496e809e80bd14fd6491, role.id=f75ffcd78e8b4fb8a4942efdd54e431f, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:24.315386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ce1fb-0d49-4e86-85ca-e1f6073935ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:24.316919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ce1fb-0d49-4e86-85ca-e1f6073935ca None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:24.323428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 190/381] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 4 18:15:24 2022] GET /identity/v3/role_assignments?group.id=e019af2c2ae2496e809e80bd14fd6491&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=f75ffcd78e8b4fb8a4942efdd54e431f => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:24.351645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:24.364489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 192/382] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:24.404880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ce1fb-0d49-4e86-85ca-e1f6073935ca None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:24.533740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ce1fb-0d49-4e86-85ca-e1f6073935ca None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:24.574564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878700e-5f5d-4fd1-83e5-1de500f6a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:24.575312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878700e-5f5d-4fd1-83e5-1de500f6a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:24.575599 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878700e-5f5d-4fd1-83e5-1de500f6a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:24.575874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878700e-5f5d-4fd1-83e5-1de500f6a2f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:24.597277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878700e-5f5d-4fd1-83e5-1de500f6a2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0878700e-5f5d-4fd1-83e5-1de500f6a2f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:24.605221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:24.606211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:24.607435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 191/383] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:24.613443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f46d0f-e476-4494-9744-7318f2b2af4d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:24.747103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f46d0f-e476-4494-9744-7318f2b2af4d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:24.787315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da707b2-c173-4ecb-bb6c-567c94c1c954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:24.788416 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da707b2-c173-4ecb-bb6c-567c94c1c954 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:24.788887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da707b2-c173-4ecb-bb6c-567c94c1c954 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:24.789372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da707b2-c173-4ecb-bb6c-567c94c1c954 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:24.790313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da707b2-c173-4ecb-bb6c-567c94c1c954 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:24.790822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da707b2-c173-4ecb-bb6c-567c94c1c954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:24.792770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da707b2-c173-4ecb-bb6c-567c94c1c954 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:24.802554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 193/384] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:24.807911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878700e-5f5d-4fd1-83e5-1de500f6a2f4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:24.825072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:24.953687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f5395-4d23-4392-bdaf-dca77f369df6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:24.954364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f5395-4d23-4392-bdaf-dca77f369df6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:24.954836 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f5395-4d23-4392-bdaf-dca77f369df6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:24.960087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 194/385] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:24.964382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878700e-5f5d-4fd1-83e5-1de500f6a2f4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:24.977731 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6eb66-8937-4bb8-abc8-5042e2279d66 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:24.978057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6eb66-8937-4bb8-abc8-5042e2279d66 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:24.978413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6eb66-8937-4bb8-abc8-5042e2279d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:25.007194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c8e6eb66-8937-4bb8-abc8-5042e2279d66 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:25.011694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c8e6eb66-8937-4bb8-abc8-5042e2279d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:25.027228 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0470bf4-4c5c-4c4d-809e-677b08590620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:25.028158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470bf4-4c5c-4c4d-809e-677b08590620 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:25.028471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470bf4-4c5c-4c4d-809e-677b08590620 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:25.028756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0470bf4-4c5c-4c4d-809e-677b08590620 None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:25.030876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0470bf4-4c5c-4c4d-809e-677b08590620 None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:25.034102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0470bf4-4c5c-4c4d-809e-677b08590620 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:25.035792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 192/386] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:24 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:25.041085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0470bf4-4c5c-4c4d-809e-677b08590620 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:25.136482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:25.149198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 195/387] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:25.153506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:25.186951 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0470bf4-4c5c-4c4d-809e-677b08590620 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:25.194391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6eb66-8937-4bb8-abc8-5042e2279d66 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:25.223351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83493cc-2ae1-4451-b564-8eb1c372e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:25.224309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83493cc-2ae1-4451-b564-8eb1c372e1ab None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:25.224597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83493cc-2ae1-4451-b564-8eb1c372e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:25.224911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83493cc-2ae1-4451-b564-8eb1c372e1ab None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:25.226120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83493cc-2ae1-4451-b564-8eb1c372e1ab None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:25.227592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83493cc-2ae1-4451-b564-8eb1c372e1ab None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:25.230243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 193/388] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:25 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:25.236719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83493cc-2ae1-4451-b564-8eb1c372e1ab None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:25.370793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6eb66-8937-4bb8-abc8-5042e2279d66 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:25.378105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83493cc-2ae1-4451-b564-8eb1c372e1ab None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:25.415769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bff2a-2940-4dc0-bfb7-3a308b412b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:25.416162 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fbd1f-cc08-45f5-b6a0-86f030d6eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:25.416619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bff2a-2940-4dc0-bfb7-3a308b412b54 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:25.416903 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bff2a-2940-4dc0-bfb7-3a308b412b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:25.416996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fbd1f-cc08-45f5-b6a0-86f030d6eddc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:25.417515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bff2a-2940-4dc0-bfb7-3a308b412b54 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b/groups/e019af2c2ae2496e809e80bd14fd6491/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:25.417622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fbd1f-cc08-45f5-b6a0-86f030d6eddc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:25.417856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fbd1f-cc08-45f5-b6a0-86f030d6eddc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:25.420303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bff2a-2940-4dc0-bfb7-3a308b412b54 None admin] RBAC: Authorizing `identity:create_grant(project_id=519eba4a80c44012af4aed921a30d31b, group_id=e019af2c2ae2496e809e80bd14fd6491, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:25.422624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bff2a-2940-4dc0-bfb7-3a308b412b54 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:25.436177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fbd1f-cc08-45f5-b6a0-86f030d6eddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:25.440898 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-715fbd1f-cc08-45f5-b6a0-86f030d6eddc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:25.446753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:25.447628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:25.449058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:25.450160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 196/389] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:15:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:25.450271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 194/390] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Jun 4 18:15:25 2022] PUT /identity/v3/projects/519eba4a80c44012af4aed921a30d31b/groups/e019af2c2ae2496e809e80bd14fd6491/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:15:25.457196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fbd1f-cc08-45f5-b6a0-86f030d6eddc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:25.516805 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:25.578257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fbd1f-cc08-45f5-b6a0-86f030d6eddc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:25.619831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8f7c3-96f4-4439-ac35-4111377a173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:25.621406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f7c3-96f4-4439-ac35-4111377a173d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:25.621881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f7c3-96f4-4439-ac35-4111377a173d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:25.622356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f7c3-96f4-4439-ac35-4111377a173d None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:25.623393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8f7c3-96f4-4439-ac35-4111377a173d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:25.623899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8f7c3-96f4-4439-ac35-4111377a173d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:25.625539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8f7c3-96f4-4439-ac35-4111377a173d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:25.636211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 197/391] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:25.642250 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bff2a-2940-4dc0-bfb7-3a308b412b54 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:25.702309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f122b3a-a0ee-4f12-a562-2796246733cb None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:25.702711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f122b3a-a0ee-4f12-a562-2796246733cb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:25.702879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f122b3a-a0ee-4f12-a562-2796246733cb None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:25.704649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 198/392] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:25.710858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f26c1-4411-4abc-a594-e1d6813c3221 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:25.711153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f26c1-4411-4abc-a594-e1d6813c3221 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:25.711568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f26c1-4411-4abc-a594-e1d6813c3221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:25.730453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a58f26c1-4411-4abc-a594-e1d6813c3221 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:25.731665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a58f26c1-4411-4abc-a594-e1d6813c3221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:25.827293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bff2a-2940-4dc0-bfb7-3a308b412b54 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:25.866411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95ebd0-b8e2-4a69-b6c2-f27c8806c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:25.866703 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 199/393] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:25.867319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ebd0-b8e2-4a69-b6c2-f27c8806c553 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:25.867605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ebd0-b8e2-4a69-b6c2-f27c8806c553 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:25.867881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ebd0-b8e2-4a69-b6c2-f27c8806c553 None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:25.870006 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95ebd0-b8e2-4a69-b6c2-f27c8806c553 None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:25.870543 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95ebd0-b8e2-4a69-b6c2-f27c8806c553 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:25.876388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 195/394] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:25 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:25.881766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f26c1-4411-4abc-a594-e1d6813c3221 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:25.895149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95ebd0-b8e2-4a69-b6c2-f27c8806c553 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:25.951132 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:25.969296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:26.000657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f26c1-4411-4abc-a594-e1d6813c3221 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:26.005319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95ebd0-b8e2-4a69-b6c2-f27c8806c553 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:26.041472 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06e571-dfd5-48fc-b9b7-781a946d1736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:26.042829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06e571-dfd5-48fc-b9b7-781a946d1736 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:26.043112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06e571-dfd5-48fc-b9b7-781a946d1736 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:26.043392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06e571-dfd5-48fc-b9b7-781a946d1736 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:26.043565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca5a96-3f98-4e99-bc3f-84402dcd9ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:26.044488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca5a96-3f98-4e99-bc3f-84402dcd9ffc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:26.044769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca5a96-3f98-4e99-bc3f-84402dcd9ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:26.045037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca5a96-3f98-4e99-bc3f-84402dcd9ffc None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:26.047130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca5a96-3f98-4e99-bc3f-84402dcd9ffc None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:26.048657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca5a96-3f98-4e99-bc3f-84402dcd9ffc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:26.050722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 200/395] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:25 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:26.054340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06e571-dfd5-48fc-b9b7-781a946d1736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:26.060245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca5a96-3f98-4e99-bc3f-84402dcd9ffc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4f06e571-dfd5-48fc-b9b7-781a946d1736 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:26.063544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:26.064447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:26.065209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 196/396] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:26.077045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06e571-dfd5-48fc-b9b7-781a946d1736 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:26.255737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06e571-dfd5-48fc-b9b7-781a946d1736 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:26.262124 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca5a96-3f98-4e99-bc3f-84402dcd9ffc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:26.278994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:26.290438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:26.300486 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34af10-cd2b-4d0b-9ce2-0f00a04e8f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:26.301546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34af10-cd2b-4d0b-9ce2-0f00a04e8f60 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:26.302030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34af10-cd2b-4d0b-9ce2-0f00a04e8f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:26.302512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34af10-cd2b-4d0b-9ce2-0f00a04e8f60 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:26.303465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34af10-cd2b-4d0b-9ce2-0f00a04e8f60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:26.303980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34af10-cd2b-4d0b-9ce2-0f00a04e8f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:26.305901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34af10-cd2b-4d0b-9ce2-0f00a04e8f60 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:26.318240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 197/397] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:26.324255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34af10-cd2b-4d0b-9ce2-0f00a04e8f60 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:26.349517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce074-d0f8-4087-8fee-4b1f558c8cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:26.350684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce074-d0f8-4087-8fee-4b1f558c8cd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:26.350684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce074-d0f8-4087-8fee-4b1f558c8cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:26.350972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce074-d0f8-4087-8fee-4b1f558c8cd1 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b/groups/e019af2c2ae2496e809e80bd14fd6491/roles/f75ffcd78e8b4fb8a4942efdd54e431f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:26.357649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ce074-d0f8-4087-8fee-4b1f558c8cd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=519eba4a80c44012af4aed921a30d31b, group_id=e019af2c2ae2496e809e80bd14fd6491, role_id=f75ffcd78e8b4fb8a4942efdd54e431f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:26.359272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ce074-d0f8-4087-8fee-4b1f558c8cd1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:26.387465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 201/398] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Jun 4 18:15:26 2022] PUT /identity/v3/projects/519eba4a80c44012af4aed921a30d31b/groups/e019af2c2ae2496e809e80bd14fd6491/roles/f75ffcd78e8b4fb8a4942efdd54e431f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:15:26.459038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34af10-cd2b-4d0b-9ce2-0f00a04e8f60 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:26.508711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f815c0-cb9a-4853-aff2-aaa0872cb88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:26.509941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f815c0-cb9a-4853-aff2-aaa0872cb88d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:26.510440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f815c0-cb9a-4853-aff2-aaa0872cb88d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:26.510912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f815c0-cb9a-4853-aff2-aaa0872cb88d None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:26.512374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f815c0-cb9a-4853-aff2-aaa0872cb88d None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:26.514112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f815c0-cb9a-4853-aff2-aaa0872cb88d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:26.516246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 198/399] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:26 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:26.522112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce074-d0f8-4087-8fee-4b1f558c8cd1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:26.652221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce074-d0f8-4087-8fee-4b1f558c8cd1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:26.695004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0cb1e-0774-4642-870b-1f983bbc14ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:26.696325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0cb1e-0774-4642-870b-1f983bbc14ac None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:26.696813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0cb1e-0774-4642-870b-1f983bbc14ac None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:26.697303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0cb1e-0774-4642-870b-1f983bbc14ac None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:26.698742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0cb1e-0774-4642-870b-1f983bbc14ac None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:26.700456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0cb1e-0774-4642-870b-1f983bbc14ac None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:26.702413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 202/400] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:26 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:26.708366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f815c0-cb9a-4853-aff2-aaa0872cb88d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:26.778682 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:26.836649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f815c0-cb9a-4853-aff2-aaa0872cb88d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:26.883719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5db11-20d4-4036-8a78-19af460da208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:26.885066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5db11-20d4-4036-8a78-19af460da208 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:26.885556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5db11-20d4-4036-8a78-19af460da208 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:26.886146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5db11-20d4-4036-8a78-19af460da208 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/groups/e019af2c2ae2496e809e80bd14fd6491/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:26.888772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5db11-20d4-4036-8a78-19af460da208 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed3cb2d0a5a4281957591c2420a9b99, group_id=e019af2c2ae2496e809e80bd14fd6491, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:26.890689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5db11-20d4-4036-8a78-19af460da208 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:26.925407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 199/401] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Jun 4 18:15:26 2022] PUT /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/groups/e019af2c2ae2496e809e80bd14fd6491/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:27.268996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd8f9-ca50-44cd-8ccd-599a54595af0 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:27.269746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd8f9-ca50-44cd-8ccd-599a54595af0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:27.270230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd8f9-ca50-44cd-8ccd-599a54595af0 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:27.272152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 203/402] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:27.277273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6d1bd-95b0-4528-84ee-77b56ad50cf8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:27.277721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6d1bd-95b0-4528-84ee-77b56ad50cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:27.277815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6d1bd-95b0-4528-84ee-77b56ad50cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:27.301697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-31a6d1bd-95b0-4528-84ee-77b56ad50cf8 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:27.302911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-31a6d1bd-95b0-4528-84ee-77b56ad50cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:27.387011 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 200/403] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:27.410839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd8f9-ca50-44cd-8ccd-599a54595af0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:27.455190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:27.538643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd8f9-ca50-44cd-8ccd-599a54595af0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:27.588578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d3a1b-dbfb-4ca5-a41e-7edec0926810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:27.589396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d3a1b-dbfb-4ca5-a41e-7edec0926810 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:27.589689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d3a1b-dbfb-4ca5-a41e-7edec0926810 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:27.589945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d3a1b-dbfb-4ca5-a41e-7edec0926810 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:27.609281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d3a1b-dbfb-4ca5-a41e-7edec0926810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7a9d3a1b-dbfb-4ca5-a41e-7edec0926810 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:27.617021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:27.618101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:27.619246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 204/404] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:27.624866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6d1bd-95b0-4528-84ee-77b56ad50cf8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:27.686083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:27.748099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6d1bd-95b0-4528-84ee-77b56ad50cf8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:27.767930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe6897-9d77-4bc7-aec9-5a245d5de153 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:27.768475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe6897-9d77-4bc7-aec9-5a245d5de153 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:27.768547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe6897-9d77-4bc7-aec9-5a245d5de153 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:27.770170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 205/405] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:27.778542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5081f1-245b-4a5e-8d58-0da583967b22 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:27.778825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5081f1-245b-4a5e-8d58-0da583967b22 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:27.779110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5081f1-245b-4a5e-8d58-0da583967b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:27.797793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7dcde-c1e9-4f70-b3bb-3dd32be265f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:27.798395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7dcde-c1e9-4f70-b3bb-3dd32be265f6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:27.798682 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7dcde-c1e9-4f70-b3bb-3dd32be265f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:27.798961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7dcde-c1e9-4f70-b3bb-3dd32be265f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:27.799722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7dcde-c1e9-4f70-b3bb-3dd32be265f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:27.800047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7dcde-c1e9-4f70-b3bb-3dd32be265f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:27.801441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7dcde-c1e9-4f70-b3bb-3dd32be265f6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:27.809761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4b5081f1-245b-4a5e-8d58-0da583967b22 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:27.811858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4b5081f1-245b-4a5e-8d58-0da583967b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:27.820167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 201/406] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:27.825444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7dcde-c1e9-4f70-b3bb-3dd32be265f6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:27.933816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 206/407] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:27.957705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5081f1-245b-4a5e-8d58-0da583967b22 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:27.986480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:28.046884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7dcde-c1e9-4f70-b3bb-3dd32be265f6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:28.066351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5081f1-245b-4a5e-8d58-0da583967b22 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:28.067451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:28.104307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550668da-b9a8-4500-b8d5-7ebe79ea859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:28.105139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550668da-b9a8-4500-b8d5-7ebe79ea859a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:28.105427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550668da-b9a8-4500-b8d5-7ebe79ea859a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:28.105707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550668da-b9a8-4500-b8d5-7ebe79ea859a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:28.116757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550668da-b9a8-4500-b8d5-7ebe79ea859a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-550668da-b9a8-4500-b8d5-7ebe79ea859a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:28.125053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:28.125934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:28.126710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 207/408] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:15:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:28.133912 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550668da-b9a8-4500-b8d5-7ebe79ea859a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:28.141573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace2656-57eb-47a1-8d59-67caa5930d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:28.146058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace2656-57eb-47a1-8d59-67caa5930d37 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:28.146488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace2656-57eb-47a1-8d59-67caa5930d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:28.146901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace2656-57eb-47a1-8d59-67caa5930d37 None admin] PATH_INFO: `/v3/groups/db763078253e4411990fec14fa8c54fc` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:28.148343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace2656-57eb-47a1-8d59-67caa5930d37 None admin] RBAC: Authorizing `identity:get_group(group_id=db763078253e4411990fec14fa8c54fc)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:28.152054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace2656-57eb-47a1-8d59-67caa5930d37 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:28.153948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 202/409] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:27 2022] GET /identity/v3/groups/db763078253e4411990fec14fa8c54fc => generated 229 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:28.163834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace2656-57eb-47a1-8d59-67caa5930d37 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:28.244987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:28.256658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550668da-b9a8-4500-b8d5-7ebe79ea859a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:28.293751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace2656-57eb-47a1-8d59-67caa5930d37 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:28.329234 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb8995-7531-4dfa-be04-b197d68fd85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:28.330191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb8995-7531-4dfa-be04-b197d68fd85c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:28.330570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb8995-7531-4dfa-be04-b197d68fd85c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:28.330940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb8995-7531-4dfa-be04-b197d68fd85c None admin] PATH_INFO: `/v3/projects/b474e20b865e43bf8fbbb839d2f225c5` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:28.332249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb8995-7531-4dfa-be04-b197d68fd85c None admin] RBAC: Authorizing `identity:get_project(project_id=b474e20b865e43bf8fbbb839d2f225c5)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:28.333912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb8995-7531-4dfa-be04-b197d68fd85c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:28.335709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 203/410] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:28 2022] GET /identity/v3/projects/b474e20b865e43bf8fbbb839d2f225c5 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:28.337281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254076f-0815-4dc5-beb5-ffa211f1ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:28.338091 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254076f-0815-4dc5-beb5-ffa211f1ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:28.338469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254076f-0815-4dc5-beb5-ffa211f1ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:28.338839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254076f-0815-4dc5-beb5-ffa211f1ebf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:28.339705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254076f-0815-4dc5-beb5-ffa211f1ebf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:28.340135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254076f-0815-4dc5-beb5-ffa211f1ebf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:28.341300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb8995-7531-4dfa-be04-b197d68fd85c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:28.346116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254076f-0815-4dc5-beb5-ffa211f1ebf6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:28.371480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 208/411] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:28.372510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254076f-0815-4dc5-beb5-ffa211f1ebf6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:28.431138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:28.537065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb8995-7531-4dfa-be04-b197d68fd85c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:28.574042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de21885-0ecb-48ad-a6b1-5ffb51cc8f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:28.574538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254076f-0815-4dc5-beb5-ffa211f1ebf6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:28.575521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de21885-0ecb-48ad-a6b1-5ffb51cc8f9a None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:28.576113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de21885-0ecb-48ad-a6b1-5ffb51cc8f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:28.576888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de21885-0ecb-48ad-a6b1-5ffb51cc8f9a None admin] PATH_INFO: `/v3/projects/b474e20b865e43bf8fbbb839d2f225c5/groups/db763078253e4411990fec14fa8c54fc/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:28.579102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de21885-0ecb-48ad-a6b1-5ffb51cc8f9a None admin] RBAC: Authorizing `identity:create_grant(project_id=b474e20b865e43bf8fbbb839d2f225c5, group_id=db763078253e4411990fec14fa8c54fc, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:28.580844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de21885-0ecb-48ad-a6b1-5ffb51cc8f9a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:28.601371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 204/412] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Jun 4 18:15:28 2022] PUT /identity/v3/projects/b474e20b865e43bf8fbbb839d2f225c5/groups/db763078253e4411990fec14fa8c54fc/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:15:28.625844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e95ec2-9fc0-4650-92a8-6cdece380c94 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:28.626166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e95ec2-9fc0-4650-92a8-6cdece380c94 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:28.626401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e95ec2-9fc0-4650-92a8-6cdece380c94 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:28.627997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 205/413] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:15:28.631361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3fd00-bb3f-49a4-84e3-bacf84280825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:28.632290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3fd00-bb3f-49a4-84e3-bacf84280825 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:28.632572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3fd00-bb3f-49a4-84e3-bacf84280825 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:28.632843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3fd00-bb3f-49a4-84e3-bacf84280825 None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:28.635324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b0c1-c18b-4bd7-99f4-af99ec37b3c5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:28.635604 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b0c1-c18b-4bd7-99f4-af99ec37b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:28.635873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b0c1-c18b-4bd7-99f4-af99ec37b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:28.640216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3fd00-bb3f-49a4-84e3-bacf84280825 None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:28.641990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3fd00-bb3f-49a4-84e3-bacf84280825 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:28.644056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 209/414] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:28 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:28.653329 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3fd00-bb3f-49a4-84e3-bacf84280825 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:28.653520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ad93b0c1-c18b-4bd7-99f4-af99ec37b3c5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:28.654813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ad93b0c1-c18b-4bd7-99f4-af99ec37b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:28.694153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:28.740917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 206/415] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:28.780946 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b0c1-c18b-4bd7-99f4-af99ec37b3c5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:28.822969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:28.886879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3fd00-bb3f-49a4-84e3-bacf84280825 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:28.907247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b0c1-c18b-4bd7-99f4-af99ec37b3c5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:28.926467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4849d85-5e4e-4a12-8419-b41428eb1c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:28.928187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4849d85-5e4e-4a12-8419-b41428eb1c0f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:28.928187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4849d85-5e4e-4a12-8419-b41428eb1c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:28.928187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4849d85-5e4e-4a12-8419-b41428eb1c0f None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:28.929948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4849d85-5e4e-4a12-8419-b41428eb1c0f None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:28.931427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4849d85-5e4e-4a12-8419-b41428eb1c0f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:28.933510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 210/416] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:28 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:28.941002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4849d85-5e4e-4a12-8419-b41428eb1c0f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:28.950753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb904d-1d4b-4302-abd7-7856f559b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:28.951631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb904d-1d4b-4302-abd7-7856f559b886 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:28.951913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb904d-1d4b-4302-abd7-7856f559b886 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:28.952448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb904d-1d4b-4302-abd7-7856f559b886 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:28.965280 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb904d-1d4b-4302-abd7-7856f559b886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-10fb904d-1d4b-4302-abd7-7856f559b886 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:28.973410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:28.974324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:28.975095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 207/417] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:28.980487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb904d-1d4b-4302-abd7-7856f559b886 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:29.058636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4849d85-5e4e-4a12-8419-b41428eb1c0f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:29.062208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:29.124691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085a460-1be3-4609-9ad1-583289373b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:29.125986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085a460-1be3-4609-9ad1-583289373b5f None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:29.126470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085a460-1be3-4609-9ad1-583289373b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:29.127615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085a460-1be3-4609-9ad1-583289373b5f None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/groups/e019af2c2ae2496e809e80bd14fd6491/roles/f75ffcd78e8b4fb8a4942efdd54e431f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:29.131928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085a460-1be3-4609-9ad1-583289373b5f None admin] RBAC: Authorizing `identity:create_grant(project_id=3ed3cb2d0a5a4281957591c2420a9b99, group_id=e019af2c2ae2496e809e80bd14fd6491, role_id=f75ffcd78e8b4fb8a4942efdd54e431f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:29.134352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085a460-1be3-4609-9ad1-583289373b5f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:29.161236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 211/418] 10.222.0.39 () {58 vars in 1442 bytes} [Sat Jun 4 18:15:28 2022] PUT /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99/groups/e019af2c2ae2496e809e80bd14fd6491/roles/f75ffcd78e8b4fb8a4942efdd54e431f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:29.193769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:29.203186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb904d-1d4b-4302-abd7-7856f559b886 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:29.250165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57d23f-7360-4b01-972f-7245bfa746a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:29.251206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d23f-7360-4b01-972f-7245bfa746a7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:29.251705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d23f-7360-4b01-972f-7245bfa746a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:29.252215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d23f-7360-4b01-972f-7245bfa746a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:29.253204 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57d23f-7360-4b01-972f-7245bfa746a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:29.253696 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57d23f-7360-4b01-972f-7245bfa746a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:29.255332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57d23f-7360-4b01-972f-7245bfa746a7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:29.268660 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 208/419] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:29.274355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085a460-1be3-4609-9ad1-583289373b5f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:29.414389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085a460-1be3-4609-9ad1-583289373b5f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:29.452976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb431f-9106-40c1-956a-2273f054db60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:29.455325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb431f-9106-40c1-956a-2273f054db60 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:29.455812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb431f-9106-40c1-956a-2273f054db60 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:29.456308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb431f-9106-40c1-956a-2273f054db60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:29.473770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:29.531251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb431f-9106-40c1-956a-2273f054db60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:29.533121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb431f-9106-40c1-956a-2273f054db60 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:29.629641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35683a-1638-47ac-9aef-58a35ce21d99 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:29.630598 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35683a-1638-47ac-9aef-58a35ce21d99 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:29.631062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35683a-1638-47ac-9aef-58a35ce21d99 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:29.633332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 209/420] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:15:29.639759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 212/421] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:29.644744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b7f82-4ae4-4e5e-bae2-112a1aec30c5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:29.644995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb431f-9106-40c1-956a-2273f054db60 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:29.645467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b7f82-4ae4-4e5e-bae2-112a1aec30c5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:29.645929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b7f82-4ae4-4e5e-bae2-112a1aec30c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:29.669963 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-189b7f82-4ae4-4e5e-bae2-112a1aec30c5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:29.673198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-189b7f82-4ae4-4e5e-bae2-112a1aec30c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:29.725596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:29.778894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb431f-9106-40c1-956a-2273f054db60 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:29.788649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 210/422] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:29.790355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b09a6e-91c7-4414-8c83-0a0986e4a80c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:29.790854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b09a6e-91c7-4414-8c83-0a0986e4a80c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:29.791340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b09a6e-91c7-4414-8c83-0a0986e4a80c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:29.793422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 211/423] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:29.805421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a73b9d-b8a0-413d-be69-4aba09500aa2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:29.805707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a73b9d-b8a0-413d-be69-4aba09500aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:29.805987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a73b9d-b8a0-413d-be69-4aba09500aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:29.824218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d6a73b9d-b8a0-413d-be69-4aba09500aa2 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:29.825427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d6a73b9d-b8a0-413d-be69-4aba09500aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:29.840583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfd01e-7280-4b7d-bec0-d98df49804d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:29.841476 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfd01e-7280-4b7d-bec0-d98df49804d3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:29.841758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfd01e-7280-4b7d-bec0-d98df49804d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:29.842064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfd01e-7280-4b7d-bec0-d98df49804d3 None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:29.843377 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfd01e-7280-4b7d-bec0-d98df49804d3 None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:29.844896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfd01e-7280-4b7d-bec0-d98df49804d3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:29.846932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 213/424] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:29 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:29.847785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfd01e-7280-4b7d-bec0-d98df49804d3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:29.899740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 212/425] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:29.900654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a73b9d-b8a0-413d-be69-4aba09500aa2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:29.927553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:29.960880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfd01e-7280-4b7d-bec0-d98df49804d3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:29.975570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:30.001318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33772877-f10f-49af-b050-99bb9cd1a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:30.002161 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33772877-f10f-49af-b050-99bb9cd1a03c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:30.002443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33772877-f10f-49af-b050-99bb9cd1a03c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:30.002716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33772877-f10f-49af-b050-99bb9cd1a03c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:30.015576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33772877-f10f-49af-b050-99bb9cd1a03c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-33772877-f10f-49af-b050-99bb9cd1a03c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:30.023868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:30.024772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:30.025593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:30.027264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a73b9d-b8a0-413d-be69-4aba09500aa2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:30.030527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 214/426] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:15:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:30.031307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33772877-f10f-49af-b050-99bb9cd1a03c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:30.071481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e511079-b1d8-4ac7-82f8-6226b3a23a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:30.072506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511079-b1d8-4ac7-82f8-6226b3a23a11 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:30.072799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511079-b1d8-4ac7-82f8-6226b3a23a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:30.073099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e511079-b1d8-4ac7-82f8-6226b3a23a11 None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:30.074711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e511079-b1d8-4ac7-82f8-6226b3a23a11 None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:30.076209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e511079-b1d8-4ac7-82f8-6226b3a23a11 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:30.078253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 213/427] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:29 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:30.083655 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e511079-b1d8-4ac7-82f8-6226b3a23a11 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:30.140544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33772877-f10f-49af-b050-99bb9cd1a03c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:30.175893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d7e02-f334-4597-a83f-d3818168c021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:30.176888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7e02-f334-4597-a83f-d3818168c021 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:30.177171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7e02-f334-4597-a83f-d3818168c021 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:30.177498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7e02-f334-4597-a83f-d3818168c021 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:30.185652 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:30.188656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d7e02-f334-4597-a83f-d3818168c021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:30.196270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e511079-b1d8-4ac7-82f8-6226b3a23a11 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-400d7e02-f334-4597-a83f-d3818168c021 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:30.197099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:30.198181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:30.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 215/428] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:30.200085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d7e02-f334-4597-a83f-d3818168c021 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:30.231102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:30.235703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9032e-73c4-46f2-82dd-7bd89aacca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:30.237056 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9032e-73c4-46f2-82dd-7bd89aacca90 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:30.237429 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9032e-73c4-46f2-82dd-7bd89aacca90 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:30.237710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9032e-73c4-46f2-82dd-7bd89aacca90 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:30.238458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9032e-73c4-46f2-82dd-7bd89aacca90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:30.238763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9032e-73c4-46f2-82dd-7bd89aacca90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:30.240192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9032e-73c4-46f2-82dd-7bd89aacca90 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:30.249504 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 214/429] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:30.250483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9032e-73c4-46f2-82dd-7bd89aacca90 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:30.330145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d7e02-f334-4597-a83f-d3818168c021 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:30.374063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd49e-8bf4-451e-9ccf-f650b586387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:30.375641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd49e-8bf4-451e-9ccf-f650b586387b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:30.376233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd49e-8bf4-451e-9ccf-f650b586387b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:30.376658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd49e-8bf4-451e-9ccf-f650b586387b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:30.378268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfd49e-8bf4-451e-9ccf-f650b586387b None admin] RBAC: Adding query filter params (group.id=e019af2c2ae2496e809e80bd14fd6491, role.id=e0e319e010e342d184a4b77ac79ecf84, scope.project.id=519eba4a80c44012af4aed921a30d31b) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:30.378734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfd49e-8bf4-451e-9ccf-f650b586387b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:30.380872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfd49e-8bf4-451e-9ccf-f650b586387b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:30.384061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9032e-73c4-46f2-82dd-7bd89aacca90 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:30.388834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 216/430] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 4 18:15:30 2022] GET /identity/v3/role_assignments?group.id=e019af2c2ae2496e809e80bd14fd6491&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:30.390050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd49e-8bf4-451e-9ccf-f650b586387b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:30.460542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fdb70-eb88-4d16-8d78-b8a6377eb065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:30.461600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fdb70-eb88-4d16-8d78-b8a6377eb065 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:30.462866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fdb70-eb88-4d16-8d78-b8a6377eb065 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:30.463433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fdb70-eb88-4d16-8d78-b8a6377eb065 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:30.464396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fdb70-eb88-4d16-8d78-b8a6377eb065 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:30.469561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fdb70-eb88-4d16-8d78-b8a6377eb065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:30.471237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fdb70-eb88-4d16-8d78-b8a6377eb065 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:30.486740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 215/431] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:15:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:30.493073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fdb70-eb88-4d16-8d78-b8a6377eb065 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:30.518453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:30.616390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:30.623093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd49e-8bf4-451e-9ccf-f650b586387b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:30.635382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fdb70-eb88-4d16-8d78-b8a6377eb065 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:30.665664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52b148-04c9-4821-8632-750a9897d2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:30.666632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52b148-04c9-4821-8632-750a9897d2ad None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:30.667015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52b148-04c9-4821-8632-750a9897d2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:30.668083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52b148-04c9-4821-8632-750a9897d2ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:30.672992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7e572-a13d-40b5-a0e4-d72716678637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:30.673859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7e572-a13d-40b5-a0e4-d72716678637 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:30.674278 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7e572-a13d-40b5-a0e4-d72716678637 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:30.674688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7e572-a13d-40b5-a0e4-d72716678637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:30.756329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7e572-a13d-40b5-a0e4-d72716678637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:30.758185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7e572-a13d-40b5-a0e4-d72716678637 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:30.759931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52b148-04c9-4821-8632-750a9897d2ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:30.761818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52b148-04c9-4821-8632-750a9897d2ad None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:30.780461 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:30.892860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 216/432] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:30.894696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:30.898637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7e572-a13d-40b5-a0e4-d72716678637 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:30.906369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 217/433] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:30.914616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52b148-04c9-4821-8632-750a9897d2ad None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:31.028365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7e572-a13d-40b5-a0e4-d72716678637 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:31.038739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52b148-04c9-4821-8632-750a9897d2ad None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:31.040356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:31.069024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24ab69-8b49-4f3c-a8b5-aebc48835cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:31.070470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24ab69-8b49-4f3c-a8b5-aebc48835cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.071160 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24ab69-8b49-4f3c-a8b5-aebc48835cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.071636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24ab69-8b49-4f3c-a8b5-aebc48835cf0 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.073532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24ab69-8b49-4f3c-a8b5-aebc48835cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:31.075128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24ab69-8b49-4f3c-a8b5-aebc48835cf0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:31.078962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 217/434] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:30 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:31.082453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a6c2d-9606-4c7b-ab19-26cfa36d8a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:31.083622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a6c2d-9606-4c7b-ab19-26cfa36d8a2d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.084188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a6c2d-9606-4c7b-ab19-26cfa36d8a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.084453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24ab69-8b49-4f3c-a8b5-aebc48835cf0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:31.084861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a6c2d-9606-4c7b-ab19-26cfa36d8a2d None admin] PATH_INFO: `/v3/projects/519eba4a80c44012af4aed921a30d31b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.086240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a6c2d-9606-4c7b-ab19-26cfa36d8a2d None admin] RBAC: Authorizing `identity:get_project(project_id=519eba4a80c44012af4aed921a30d31b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:31.087914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a6c2d-9606-4c7b-ab19-26cfa36d8a2d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:31.091260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 218/435] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:30 2022] GET /identity/v3/projects/519eba4a80c44012af4aed921a30d31b => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:31.097678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a6c2d-9606-4c7b-ab19-26cfa36d8a2d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:31.172632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:31.215885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a6c2d-9606-4c7b-ab19-26cfa36d8a2d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:31.221200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24ab69-8b49-4f3c-a8b5-aebc48835cf0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:31.258628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6c412-4ef1-49b7-bd36-ede5a4667d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:31.259777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6c412-4ef1-49b7-bd36-ede5a4667d58 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.260263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6c412-4ef1-49b7-bd36-ede5a4667d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.260610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6c412-4ef1-49b7-bd36-ede5a4667d58 None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.261578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e6c1d-0340-476d-b2ba-f6cdfa14f17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:31.262059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6c412-4ef1-49b7-bd36-ede5a4667d58 None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:31.262840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e6c1d-0340-476d-b2ba-f6cdfa14f17d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.263289 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e6c1d-0340-476d-b2ba-f6cdfa14f17d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.263724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e6c1d-0340-476d-b2ba-f6cdfa14f17d None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.263822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6c412-4ef1-49b7-bd36-ede5a4667d58 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:31.265271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e6c1d-0340-476d-b2ba-f6cdfa14f17d None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:31.266013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 218/436] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:31 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:31.267103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e6c1d-0340-476d-b2ba-f6cdfa14f17d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:31.268937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 219/437] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:31 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:31.273234 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6c412-4ef1-49b7-bd36-ede5a4667d58 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:31.277167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e6c1d-0340-476d-b2ba-f6cdfa14f17d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:31.337764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:31.384384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e6c1d-0340-476d-b2ba-f6cdfa14f17d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:31.397417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6c412-4ef1-49b7-bd36-ede5a4667d58 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:31.423218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:31.429639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f190e-f573-429a-9768-9aa28494842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:31.430757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f190e-f573-429a-9768-9aa28494842a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.431439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f190e-f573-429a-9768-9aa28494842a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.432287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f190e-f573-429a-9768-9aa28494842a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.433568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f190e-f573-429a-9768-9aa28494842a None admin] RBAC: Adding query filter params (group.id=e019af2c2ae2496e809e80bd14fd6491, role.id=f75ffcd78e8b4fb8a4942efdd54e431f, scope.project.id=519eba4a80c44012af4aed921a30d31b) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:31.434178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f190e-f573-429a-9768-9aa28494842a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:31.435755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f190e-f573-429a-9768-9aa28494842a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:31.436717 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5b73d-029b-4856-8146-030c6cede83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:31.437376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5b73d-029b-4856-8146-030c6cede83c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.437715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5b73d-029b-4856-8146-030c6cede83c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.437933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5b73d-029b-4856-8146-030c6cede83c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.439021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5b73d-029b-4856-8146-030c6cede83c None admin] RBAC: Adding query filter params (group.id=e019af2c2ae2496e809e80bd14fd6491, role.id=e0e319e010e342d184a4b77ac79ecf84, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:31.439123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5b73d-029b-4856-8146-030c6cede83c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:31.440540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5b73d-029b-4856-8146-030c6cede83c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:31.442258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 220/438] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 4 18:15:31 2022] GET /identity/v3/role_assignments?group.id=e019af2c2ae2496e809e80bd14fd6491&scope.project.id=519eba4a80c44012af4aed921a30d31b&role.id=f75ffcd78e8b4fb8a4942efdd54e431f => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:31.443583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d246-a38d-452b-bc63-2cb9aa4f4510 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.443866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d246-a38d-452b-bc63-2cb9aa4f4510 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.444169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d246-a38d-452b-bc63-2cb9aa4f4510 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.445560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 221/439] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:31.451231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224076-33d6-4fe7-a7ef-5f23e3cd288f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.451917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224076-33d6-4fe7-a7ef-5f23e3cd288f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.452221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224076-33d6-4fe7-a7ef-5f23e3cd288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.460465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 219/440] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 4 18:15:31 2022] GET /identity/v3/role_assignments?group.id=e019af2c2ae2496e809e80bd14fd6491&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=e0e319e010e342d184a4b77ac79ecf84 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:31.472831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-db224076-33d6-4fe7-a7ef-5f23e3cd288f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:31.474104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-db224076-33d6-4fe7-a7ef-5f23e3cd288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:31.560338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 222/441] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:31.580753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5b73d-029b-4856-8146-030c6cede83c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:31.705716 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5b73d-029b-4856-8146-030c6cede83c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:31.717806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:31.745248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feaf9b-9ad3-4aea-a070-00be9ae19a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:31.746063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feaf9b-9ad3-4aea-a070-00be9ae19a00 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.746341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feaf9b-9ad3-4aea-a070-00be9ae19a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.746606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feaf9b-9ad3-4aea-a070-00be9ae19a00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.757453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0feaf9b-9ad3-4aea-a070-00be9ae19a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e0feaf9b-9ad3-4aea-a070-00be9ae19a00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:31.765257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:31.766164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:31.767004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 220/442] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:15:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:31.772350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db224076-33d6-4fe7-a7ef-5f23e3cd288f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:31.879066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db224076-33d6-4fe7-a7ef-5f23e3cd288f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:31.905881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:31.911346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4097f2-a5a0-403d-ba4b-a9005097e18b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.911903 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4097f2-a5a0-403d-ba4b-a9005097e18b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.912440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4097f2-a5a0-403d-ba4b-a9005097e18b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.913821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 221/443] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:15:31.916473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004bca1-16fd-4307-8fd6-86df453fe76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:31.917150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004bca1-16fd-4307-8fd6-86df453fe76c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.917773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004bca1-16fd-4307-8fd6-86df453fe76c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.918040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004bca1-16fd-4307-8fd6-86df453fe76c None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.919112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004bca1-16fd-4307-8fd6-86df453fe76c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:31.919441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004bca1-16fd-4307-8fd6-86df453fe76c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:31.919800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db59c7-2e07-4f58-aeca-318a3f541cd6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:31.920209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db59c7-2e07-4f58-aeca-318a3f541cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:31.920476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db59c7-2e07-4f58-aeca-318a3f541cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:31.921014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004bca1-16fd-4307-8fd6-86df453fe76c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:31.931881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 223/444] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:31.938033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004bca1-16fd-4307-8fd6-86df453fe76c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:31.940629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-38db59c7-2e07-4f58-aeca-318a3f541cd6 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:31.941840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-38db59c7-2e07-4f58-aeca-318a3f541cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:32.028949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 222/445] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:32.052769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db59c7-2e07-4f58-aeca-318a3f541cd6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:32.157655 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:32.160506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db59c7-2e07-4f58-aeca-318a3f541cd6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:32.173935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004bca1-16fd-4307-8fd6-86df453fe76c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:32.197103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03177e95-ab66-4175-b45c-cf8c77d19108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:32.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177e95-ab66-4175-b45c-cf8c77d19108 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:32.198193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177e95-ab66-4175-b45c-cf8c77d19108 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:32.198470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177e95-ab66-4175-b45c-cf8c77d19108 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:32.207554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44139e2d-6960-4a7c-94a4-de8061525b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:32.208305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44139e2d-6960-4a7c-94a4-de8061525b5a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:32.208783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44139e2d-6960-4a7c-94a4-de8061525b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:32.208961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03177e95-ab66-4175-b45c-cf8c77d19108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:32.210540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44139e2d-6960-4a7c-94a4-de8061525b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-03177e95-ab66-4175-b45c-cf8c77d19108 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:32.216912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:32.217865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:32.218641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:32.219223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 223/446] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:15:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:32.224578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03177e95-ab66-4175-b45c-cf8c77d19108 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:32.267394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:32.280651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44139e2d-6960-4a7c-94a4-de8061525b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:32.282175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44139e2d-6960-4a7c-94a4-de8061525b5a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:32.328573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03177e95-ab66-4175-b45c-cf8c77d19108 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:32.361728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be62d-52a9-4f63-be34-44453f3ad4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:32.362438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be62d-52a9-4f63-be34-44453f3ad4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:32.362722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be62d-52a9-4f63-be34-44453f3ad4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:32.362998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568be62d-52a9-4f63-be34-44453f3ad4c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:32.363751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568be62d-52a9-4f63-be34-44453f3ad4c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:32.364090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568be62d-52a9-4f63-be34-44453f3ad4c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:32.365513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568be62d-52a9-4f63-be34-44453f3ad4c0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:32.373403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 224/447] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:32.380652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 224/448] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 18:15:32.385806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be62d-52a9-4f63-be34-44453f3ad4c0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:32.386120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44139e2d-6960-4a7c-94a4-de8061525b5a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:32.411616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:32.478585 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:32.489874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568be62d-52a9-4f63-be34-44453f3ad4c0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:32.490997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44139e2d-6960-4a7c-94a4-de8061525b5a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:32.524376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904d55a-188f-4605-8a6f-35ee78f72572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:32.525021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904d55a-188f-4605-8a6f-35ee78f72572 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:32.525309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904d55a-188f-4605-8a6f-35ee78f72572 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:32.525572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904d55a-188f-4605-8a6f-35ee78f72572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:32.529415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd539f4-c29c-4cf1-8221-da2beb768edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:32.530383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd539f4-c29c-4cf1-8221-da2beb768edd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:32.530726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd539f4-c29c-4cf1-8221-da2beb768edd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:32.531077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd539f4-c29c-4cf1-8221-da2beb768edd None admin] PATH_INFO: `/v3/projects/b474e20b865e43bf8fbbb839d2f225c5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:32.532430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd539f4-c29c-4cf1-8221-da2beb768edd None admin] RBAC: Authorizing `identity:get_project(project_id=b474e20b865e43bf8fbbb839d2f225c5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:32.533880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd539f4-c29c-4cf1-8221-da2beb768edd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:32.535580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 225/449] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:32 2022] GET /identity/v3/projects/b474e20b865e43bf8fbbb839d2f225c5 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:32.541041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd539f4-c29c-4cf1-8221-da2beb768edd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:32.592767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904d55a-188f-4605-8a6f-35ee78f72572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:32.594256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904d55a-188f-4605-8a6f-35ee78f72572 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:32.616838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:32.640422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd539f4-c29c-4cf1-8221-da2beb768edd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:32.674870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53098f3-4ec7-4183-ba79-a2545b194aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:32.675737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53098f3-4ec7-4183-ba79-a2545b194aac None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:32.675989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53098f3-4ec7-4183-ba79-a2545b194aac None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:32.676305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53098f3-4ec7-4183-ba79-a2545b194aac None admin] PATH_INFO: `/v3/groups/db763078253e4411990fec14fa8c54fc` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:32.677509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53098f3-4ec7-4183-ba79-a2545b194aac None admin] RBAC: Authorizing `identity:get_group(group_id=db763078253e4411990fec14fa8c54fc)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:32.678976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53098f3-4ec7-4183-ba79-a2545b194aac None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:32.680602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 226/450] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:32 2022] GET /identity/v3/groups/db763078253e4411990fec14fa8c54fc => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:32.686675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53098f3-4ec7-4183-ba79-a2545b194aac None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:32.690792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 225/451] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:32.696193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904d55a-188f-4605-8a6f-35ee78f72572 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:32.711510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:32.786923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53098f3-4ec7-4183-ba79-a2545b194aac None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:32.793150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904d55a-188f-4605-8a6f-35ee78f72572 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:32.815253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:32.822675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d9b4c-8884-4cea-ae39-79c9db8d53be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:32.823343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d9b4c-8884-4cea-ae39-79c9db8d53be None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:32.823626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d9b4c-8884-4cea-ae39-79c9db8d53be None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:32.823884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d9b4c-8884-4cea-ae39-79c9db8d53be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:32.824757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d9b4c-8884-4cea-ae39-79c9db8d53be None admin] RBAC: Adding query filter params (group.id=db763078253e4411990fec14fa8c54fc, role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=b474e20b865e43bf8fbbb839d2f225c5) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:32.825072 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d9b4c-8884-4cea-ae39-79c9db8d53be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:32.826592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d9b4c-8884-4cea-ae39-79c9db8d53be None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:32.826890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774b1c9-d3cb-4172-99ba-0c7e01937003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:32.827751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b1c9-d3cb-4172-99ba-0c7e01937003 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:32.828054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b1c9-d3cb-4172-99ba-0c7e01937003 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:32.828334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b1c9-d3cb-4172-99ba-0c7e01937003 None admin] PATH_INFO: `/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:32.829503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774b1c9-d3cb-4172-99ba-0c7e01937003 None admin] RBAC: Authorizing `identity:get_project(project_id=3ed3cb2d0a5a4281957591c2420a9b99)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:32.830926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774b1c9-d3cb-4172-99ba-0c7e01937003 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:32.832333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 227/452] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 4 18:15:32 2022] GET /identity/v3/role_assignments?group.id=db763078253e4411990fec14fa8c54fc&scope.project.id=b474e20b865e43bf8fbbb839d2f225c5&role.id=9f557e97d94b4b499a6765419452e1ef => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:32.832948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 226/453] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:15:32 2022] GET /identity/v3/projects/3ed3cb2d0a5a4281957591c2420a9b99 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:32.840804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d9b4c-8884-4cea-ae39-79c9db8d53be None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:32.942875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:32.956733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d9b4c-8884-4cea-ae39-79c9db8d53be None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:32.993650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dcc7d-9b7f-49b2-a7ea-ebb088987385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:32.994526 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dcc7d-9b7f-49b2-a7ea-ebb088987385 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:32.994802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dcc7d-9b7f-49b2-a7ea-ebb088987385 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:32.995078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dcc7d-9b7f-49b2-a7ea-ebb088987385 None admin] PATH_INFO: `/v3/groups/e019af2c2ae2496e809e80bd14fd6491` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:32.996367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dcc7d-9b7f-49b2-a7ea-ebb088987385 None admin] RBAC: Authorizing `identity:get_group(group_id=e019af2c2ae2496e809e80bd14fd6491)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:32.997819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dcc7d-9b7f-49b2-a7ea-ebb088987385 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:32.999738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 228/454] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Jun 4 18:15:32 2022] GET /identity/v3/groups/e019af2c2ae2496e809e80bd14fd6491 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:33.006202 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774b1c9-d3cb-4172-99ba-0c7e01937003 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:33.110691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774b1c9-d3cb-4172-99ba-0c7e01937003 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:33.141622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdecaf-69f9-4760-9971-5e7064e38c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:33.142262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdecaf-69f9-4760-9971-5e7064e38c6f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:33.142549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdecaf-69f9-4760-9971-5e7064e38c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:33.142818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdecaf-69f9-4760-9971-5e7064e38c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:33.143640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdecaf-69f9-4760-9971-5e7064e38c6f None admin] RBAC: Adding query filter params (group.id=e019af2c2ae2496e809e80bd14fd6491, role.id=f75ffcd78e8b4fb8a4942efdd54e431f, scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:33.143954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdecaf-69f9-4760-9971-5e7064e38c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:33.145424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdecaf-69f9-4760-9971-5e7064e38c6f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:33.151270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 227/455] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Jun 4 18:15:33 2022] GET /identity/v3/role_assignments?group.id=e019af2c2ae2496e809e80bd14fd6491&scope.project.id=3ed3cb2d0a5a4281957591c2420a9b99&role.id=f75ffcd78e8b4fb8a4942efdd54e431f => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:35.934970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b732be-7260-48ba-afb2-6a8215ea5043 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:35.936238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b732be-7260-48ba-afb2-6a8215ea5043 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:35.936866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b732be-7260-48ba-afb2-6a8215ea5043 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:35.938475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 229/456] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:35.949768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09196-bf14-4ce5-84e9-a1be48d4abd1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:35.950746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09196-bf14-4ce5-84e9-a1be48d4abd1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:35.951215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe09196-bf14-4ce5-84e9-a1be48d4abd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:35.977112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0fe09196-bf14-4ce5-84e9-a1be48d4abd1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:35.978753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0fe09196-bf14-4ce5-84e9-a1be48d4abd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:36.044833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:36.069906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 228/457] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:36.111309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b732be-7260-48ba-afb2-6a8215ea5043 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:36.259753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b732be-7260-48ba-afb2-6a8215ea5043 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:36.306713 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391251b6-6c8e-41f5-b311-a42914f8be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:36.307545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391251b6-6c8e-41f5-b311-a42914f8be3f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:36.307826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391251b6-6c8e-41f5-b311-a42914f8be3f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:36.308124 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391251b6-6c8e-41f5-b311-a42914f8be3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:36.327712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391251b6-6c8e-41f5-b311-a42914f8be3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:36.329211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391251b6-6c8e-41f5-b311-a42914f8be3f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-391251b6-6c8e-41f5-b311-a42914f8be3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:36.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:36.359040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:36.359861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:36.359861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:36.359861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:36.359861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:36.359861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 230/458] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:36.365932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe09196-bf14-4ce5-84e9-a1be48d4abd1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:36.379861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bc9dd-c44a-454d-bfbc-a1e3ea44b9c8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:36.380198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bc9dd-c44a-454d-bfbc-a1e3ea44b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:36.380440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bc9dd-c44a-454d-bfbc-a1e3ea44b9c8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:36.382089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 231/459] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:15:36.387023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33244dba-e036-44ed-adf6-b023c66c24e6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:36.387303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33244dba-e036-44ed-adf6-b023c66c24e6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:36.387581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33244dba-e036-44ed-adf6-b023c66c24e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:36.405450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-33244dba-e036-44ed-adf6-b023c66c24e6 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:36.406643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-33244dba-e036-44ed-adf6-b023c66c24e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:36.408766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:36.501645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 232/460] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:36.533728 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f6c9-cd60-40f5-96aa-d2fa6b442c10 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:36.534568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f6c9-cd60-40f5-96aa-d2fa6b442c10 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:36.535071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f6c9-cd60-40f5-96aa-d2fa6b442c10 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:36.537824 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 233/461] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:15:36.541995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe09196-bf14-4ce5-84e9-a1be48d4abd1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:36.543641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41b5a8-f10d-4794-81fe-16cf100634fe None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:36.543919 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41b5a8-f10d-4794-81fe-16cf100634fe None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:36.544223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41b5a8-f10d-4794-81fe-16cf100634fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:36.561466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ca41b5a8-f10d-4794-81fe-16cf100634fe None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:36.562984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ca41b5a8-f10d-4794-81fe-16cf100634fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:36.592690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d4778-3a84-460a-804a-e052bfd4925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:36.593368 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d4778-3a84-460a-804a-e052bfd4925f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:36.593648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d4778-3a84-460a-804a-e052bfd4925f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:36.593918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d4778-3a84-460a-804a-e052bfd4925f None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:36.594647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d4778-3a84-460a-804a-e052bfd4925f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:36.594948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d4778-3a84-460a-804a-e052bfd4925f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:36.596640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d4778-3a84-460a-804a-e052bfd4925f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:36.616091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 229/462] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:36.617296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d4778-3a84-460a-804a-e052bfd4925f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:36.646242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 234/463] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:36.647388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41b5a8-f10d-4794-81fe-16cf100634fe None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:36.671701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:36.716121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:36.736629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d4778-3a84-460a-804a-e052bfd4925f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:36.756488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41b5a8-f10d-4794-81fe-16cf100634fe None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:36.778362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0488c-ab3f-4ce2-b1b9-4e64d6720225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:36.779495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0488c-ab3f-4ce2-b1b9-4e64d6720225 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:36.779918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0488c-ab3f-4ce2-b1b9-4e64d6720225 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:36.780455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0488c-ab3f-4ce2-b1b9-4e64d6720225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:36.792757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0488c-ab3f-4ce2-b1b9-4e64d6720225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:36.794603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0488c-ab3f-4ce2-b1b9-4e64d6720225 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:36.796167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c97ad-c73a-4576-88d8-dc7d79f45ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:36.796835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c97ad-c73a-4576-88d8-dc7d79f45ce7 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:36.797217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c97ad-c73a-4576-88d8-dc7d79f45ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:36.797582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c97ad-c73a-4576-88d8-dc7d79f45ce7 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:36.798385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c97ad-c73a-4576-88d8-dc7d79f45ce7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:36.799913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c97ad-c73a-4576-88d8-dc7d79f45ce7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-73a0488c-ab3f-4ce2-b1b9-4e64d6720225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:36.816595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:36.817482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:36.818450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:36.818450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:36.818450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:36.818450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:36.825160 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 230/464] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:36.825290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0488c-ab3f-4ce2-b1b9-4e64d6720225 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:36.828763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 235/465] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:15:36 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:15:36.829597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c97ad-c73a-4576-88d8-dc7d79f45ce7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:36.937248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c97ad-c73a-4576-88d8-dc7d79f45ce7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:36.962659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:36.976698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3f220-063f-4524-a7c2-8d4b4f2b9f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:36.977317 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3f220-063f-4524-a7c2-8d4b4f2b9f3a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:36.977599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3f220-063f-4524-a7c2-8d4b4f2b9f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:36.977970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3f220-063f-4524-a7c2-8d4b4f2b9f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:36.979646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3f220-063f-4524-a7c2-8d4b4f2b9f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:36.979958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3f220-063f-4524-a7c2-8d4b4f2b9f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:36.981422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3f220-063f-4524-a7c2-8d4b4f2b9f3a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:37.004690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 236/466] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:37.018934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3f220-063f-4524-a7c2-8d4b4f2b9f3a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:37.027437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:37.034605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0488c-ab3f-4ce2-b1b9-4e64d6720225 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:37.071642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea6876-3e49-45e2-af34-b15977ad4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:37.072736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6876-3e49-45e2-af34-b15977ad4ace None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.073156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6876-3e49-45e2-af34-b15977ad4ace None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.073586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea6876-3e49-45e2-af34-b15977ad4ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.086647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea6876-3e49-45e2-af34-b15977ad4ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:37.088412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea6876-3e49-45e2-af34-b15977ad4ace None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-deea6876-3e49-45e2-af34-b15977ad4ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:37.110296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:37.111213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:37.112045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:37.112045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:37.112045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:37.112045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:37.112045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 231/467] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:37.113513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eea7a-7bf1-4570-86ed-ab364a5c9c3b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.113802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eea7a-7bf1-4570-86ed-ab364a5c9c3b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.114075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eea7a-7bf1-4570-86ed-ab364a5c9c3b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.115715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 232/468] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:37.117135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62d00-6585-41c9-9326-a484d73c3bc0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.117418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62d00-6585-41c9-9326-a484d73c3bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.117689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b62d00-6585-41c9-9326-a484d73c3bc0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.119490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 233/469] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:37.121052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d333b-06f4-41df-a062-a25041826868 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.121342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d333b-06f4-41df-a062-a25041826868 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.121724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d333b-06f4-41df-a062-a25041826868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.140838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-db8d333b-06f4-41df-a062-a25041826868 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:37.142065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-db8d333b-06f4-41df-a062-a25041826868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:37.172292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3f220-063f-4524-a7c2-8d4b4f2b9f3a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:37.213742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07760a8b-88ce-4c18-82a8-d1eb60ec4d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:37.213742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07760a8b-88ce-4c18-82a8-d1eb60ec4d1f None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.214019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07760a8b-88ce-4c18-82a8-d1eb60ec4d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.214276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07760a8b-88ce-4c18-82a8-d1eb60ec4d1f None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.215330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07760a8b-88ce-4c18-82a8-d1eb60ec4d1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:37.217262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07760a8b-88ce-4c18-82a8-d1eb60ec4d1f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:37.220171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 234/470] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:37.221036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d333b-06f4-41df-a062-a25041826868 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:37.245013 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 237/471] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:15:37 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:15:37.246311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e67227-bb56-4898-8749-8f35834b1d32 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.246597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e67227-bb56-4898-8749-8f35834b1d32 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.246870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e67227-bb56-4898-8749-8f35834b1d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.265593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b1e67227-bb56-4898-8749-8f35834b1d32 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:37.266844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b1e67227-bb56-4898-8749-8f35834b1d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:37.321123 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:37.328375 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:37.364488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 238/472] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:37.365716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e67227-bb56-4898-8749-8f35834b1d32 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:37.366584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d333b-06f4-41df-a062-a25041826868 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:37.409172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa725a72-5638-4260-8893-03b977109b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:37.410262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa725a72-5638-4260-8893-03b977109b0e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.410737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa725a72-5638-4260-8893-03b977109b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.411201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa725a72-5638-4260-8893-03b977109b0e None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.412206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa725a72-5638-4260-8893-03b977109b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:37.412713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa725a72-5638-4260-8893-03b977109b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:37.414433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa725a72-5638-4260-8893-03b977109b0e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:37.428779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 235/473] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:37.430015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa725a72-5638-4260-8893-03b977109b0e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:37.486270 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e67227-bb56-4898-8749-8f35834b1d32 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:37.531778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c628811-1b6a-4ffd-ac69-f32065ad91cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:37.533047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c628811-1b6a-4ffd-ac69-f32065ad91cf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.533475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c628811-1b6a-4ffd-ac69-f32065ad91cf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.533747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c628811-1b6a-4ffd-ac69-f32065ad91cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.547134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c628811-1b6a-4ffd-ac69-f32065ad91cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:37.548710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c628811-1b6a-4ffd-ac69-f32065ad91cf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:37.562177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa725a72-5638-4260-8893-03b977109b0e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1c628811-1b6a-4ffd-ac69-f32065ad91cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:37.567590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:37.568461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:37.569727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:37.569727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:37.569727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:37.569727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:37.569727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 239/474] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:37.570583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c628811-1b6a-4ffd-ac69-f32065ad91cf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:37.602109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033546c-aea8-4b3f-83f4-ac428cccd3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:37.602698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033546c-aea8-4b3f-83f4-ac428cccd3b7 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.602981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033546c-aea8-4b3f-83f4-ac428cccd3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.603257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033546c-aea8-4b3f-83f4-ac428cccd3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.604034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033546c-aea8-4b3f-83f4-ac428cccd3b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:37.604447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:37.605469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033546c-aea8-4b3f-83f4-ac428cccd3b7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:37.612932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.sql.core [None req-0033546c-aea8-4b3f-83f4-ac428cccd3b7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 04 18:15:37.612932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 04 18:15:37.612932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [parameters: {'id': '6224bac919c4453b98172351948b9d89', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 04 18:15:37.612932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80214) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0033546c-aea8-4b3f-83f4-ac428cccd3b7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Jun 04 18:15:37.635120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return ref.to_dict() Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 18:15:37.636104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application yield resource Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise self.value Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application session.commit() Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 18:15:37.637004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.flush() Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application compat.raise_( Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 18:15:37.638580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 18:15:37.640301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 18:15:37.641321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [parameters: {'id': '6224bac919c4453b98172351948b9d89', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:37.642244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 04 18:15:37.643224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:37.653489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 236/475] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Jun 4 18:15:37 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:37.653489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033546c-aea8-4b3f-83f4-ac428cccd3b7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:37.653489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:37.697746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c628811-1b6a-4ffd-ac69-f32065ad91cf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:37.743189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7120b2-5d5d-4465-ba17-48b6ac9e7b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:37.743893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7120b2-5d5d-4465-ba17-48b6ac9e7b52 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.744306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7120b2-5d5d-4465-ba17-48b6ac9e7b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.744625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7120b2-5d5d-4465-ba17-48b6ac9e7b52 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.745778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7120b2-5d5d-4465-ba17-48b6ac9e7b52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:37.748127 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7120b2-5d5d-4465-ba17-48b6ac9e7b52 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:37.771650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033546c-aea8-4b3f-83f4-ac428cccd3b7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:37.784755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 240/476] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:15:37 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:15:37.785813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7120b2-5d5d-4465-ba17-48b6ac9e7b52 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:37.818221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922cff-6594-4736-8389-c407837f9294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:37.818981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922cff-6594-4736-8389-c407837f9294 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:37.819267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922cff-6594-4736-8389-c407837f9294 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:37.819544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922cff-6594-4736-8389-c407837f9294 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:37.820399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922cff-6594-4736-8389-c407837f9294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:37.820716 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922cff-6594-4736-8389-c407837f9294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:37.822151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922cff-6594-4736-8389-c407837f9294 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:37.836394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 237/477] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:37.842331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922cff-6594-4736-8389-c407837f9294 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:37.918100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:37.923017 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:37.965868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7120b2-5d5d-4465-ba17-48b6ac9e7b52 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:38.008324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068489a1-6451-4dc0-8897-4361bc17123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:38.009486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068489a1-6451-4dc0-8897-4361bc17123b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:38.009976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068489a1-6451-4dc0-8897-4361bc17123b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:38.010404 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068489a1-6451-4dc0-8897-4361bc17123b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:38.024850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068489a1-6451-4dc0-8897-4361bc17123b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:38.034996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922cff-6594-4736-8389-c407837f9294 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-068489a1-6451-4dc0-8897-4361bc17123b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:38.035940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:38.036845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 18:15:38.037624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:38.040195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 241/478] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:15:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:38.049859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068489a1-6451-4dc0-8897-4361bc17123b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:38.077548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16250e-c773-45eb-b5f0-1a066d44c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:38.078390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16250e-c773-45eb-b5f0-1a066d44c40a None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:38.078735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16250e-c773-45eb-b5f0-1a066d44c40a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:38.079076 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16250e-c773-45eb-b5f0-1a066d44c40a None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:38.079919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16250e-c773-45eb-b5f0-1a066d44c40a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:38.081501 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16250e-c773-45eb-b5f0-1a066d44c40a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:38.104816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 238/479] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:15:37 2022] POST /identity/v3/users => generated 249 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:15:38.188414 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068489a1-6451-4dc0-8897-4361bc17123b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:38.229153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb379ce-7dce-4651-8534-f97025f67a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:38.230089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb379ce-7dce-4651-8534-f97025f67a21 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:38.230510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb379ce-7dce-4651-8534-f97025f67a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:38.230922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb379ce-7dce-4651-8534-f97025f67a21 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:38.231854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb379ce-7dce-4651-8534-f97025f67a21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:38.232343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb379ce-7dce-4651-8534-f97025f67a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:38.233942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb379ce-7dce-4651-8534-f97025f67a21 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:38.240223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:38.245642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 242/480] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:39.519086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fa5b9-ad41-46a7-8769-a79a5f99390c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:39.519642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fa5b9-ad41-46a7-8769-a79a5f99390c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:39.519642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fa5b9-ad41-46a7-8769-a79a5f99390c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:39.521452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 239/481] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:39.527095 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf0a9-b408-4d43-8435-8e184ccf6324 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:39.527478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf0a9-b408-4d43-8435-8e184ccf6324 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:39.527662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf0a9-b408-4d43-8435-8e184ccf6324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:39.548075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-edadf0a9-b408-4d43-8435-8e184ccf6324 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:39.549272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-edadf0a9-b408-4d43-8435-8e184ccf6324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:39.650717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 243/482] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:39.695344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fa5b9-ad41-46a7-8769-a79a5f99390c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:39.829662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fa5b9-ad41-46a7-8769-a79a5f99390c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:39.852061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:39.879671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13618-2ceb-4c0d-8e7d-c1e77132b93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:39.880518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13618-2ceb-4c0d-8e7d-c1e77132b93d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:39.880858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13618-2ceb-4c0d-8e7d-c1e77132b93d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:39.881134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13618-2ceb-4c0d-8e7d-c1e77132b93d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:39.898123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f13618-2ceb-4c0d-8e7d-c1e77132b93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-98f13618-2ceb-4c0d-8e7d-c1e77132b93d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:39.905994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:39.906835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:39.908026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 240/483] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:39.913014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadf0a9-b408-4d43-8435-8e184ccf6324 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:39.928804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281307c-4461-4b77-8294-fd72bc3c9ef8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:39.929114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281307c-4461-4b77-8294-fd72bc3c9ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:39.929358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281307c-4461-4b77-8294-fd72bc3c9ef8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:39.931006 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 241/484] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:39.941678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795a1e-3c38-4128-a0f7-d4d179e78d66 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:39.941970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795a1e-3c38-4128-a0f7-d4d179e78d66 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:39.942235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795a1e-3c38-4128-a0f7-d4d179e78d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:39.977116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7f795a1e-3c38-4128-a0f7-d4d179e78d66 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:39.978319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7f795a1e-3c38-4128-a0f7-d4d179e78d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:40.030428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadf0a9-b408-4d43-8435-8e184ccf6324 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:40.064587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:40.075452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726ce1-0636-487b-a42f-d4a5100838d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:40.076329 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726ce1-0636-487b-a42f-d4a5100838d9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:40.076623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726ce1-0636-487b-a42f-d4a5100838d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:40.076897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15726ce1-0636-487b-a42f-d4a5100838d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:40.077664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15726ce1-0636-487b-a42f-d4a5100838d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:40.077973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15726ce1-0636-487b-a42f-d4a5100838d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:40.083339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15726ce1-0636-487b-a42f-d4a5100838d9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:40.098797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 244/485] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:40.103730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726ce1-0636-487b-a42f-d4a5100838d9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:40.111025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 242/486] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:40.151288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795a1e-3c38-4128-a0f7-d4d179e78d66 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:40.252276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15726ce1-0636-487b-a42f-d4a5100838d9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:40.287888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9771-6c42-4401-81db-41d3e4902184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:40.288730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9771-6c42-4401-81db-41d3e4902184 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:40.289018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9771-6c42-4401-81db-41d3e4902184 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:40.289297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9771-6c42-4401-81db-41d3e4902184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:40.302943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea9771-6c42-4401-81db-41d3e4902184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:40.302943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea9771-6c42-4401-81db-41d3e4902184 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-09ea9771-6c42-4401-81db-41d3e4902184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:40.321431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:40.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:40.323240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:40.323240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:40.323240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:40.323240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:40.323240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 245/487] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:40.326122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795a1e-3c38-4128-a0f7-d4d179e78d66 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:40.332996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9771-6c42-4401-81db-41d3e4902184 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:40.337147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:40.371335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07d210-2b93-471b-922e-7a43c42ccc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:40.372575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07d210-2b93-471b-922e-7a43c42ccc62 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:40.380032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07d210-2b93-471b-922e-7a43c42ccc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:40.380724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07d210-2b93-471b-922e-7a43c42ccc62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:40.403587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07d210-2b93-471b-922e-7a43c42ccc62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1d07d210-2b93-471b-922e-7a43c42ccc62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:40.411681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:40.412588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:40.413384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:40.422228 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 243/488] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:40.429306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07d210-2b93-471b-922e-7a43c42ccc62 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:40.434217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:40.454850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9771-6c42-4401-81db-41d3e4902184 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:40.496049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6dc59-2802-492e-a042-751cae10016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:40.497055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6dc59-2802-492e-a042-751cae10016b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:40.497460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6dc59-2802-492e-a042-751cae10016b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:40.497851 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6dc59-2802-492e-a042-751cae10016b None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:40.498927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6dc59-2802-492e-a042-751cae10016b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:40.499370 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6dc59-2802-492e-a042-751cae10016b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:40.501071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6dc59-2802-492e-a042-751cae10016b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:40.516565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 246/489] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:40.526379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6dc59-2802-492e-a042-751cae10016b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:40.644084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07d210-2b93-471b-922e-7a43c42ccc62 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:40.687660 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb3e2-ed22-471f-a77e-a06f9ad36ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:40.688874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb3e2-ed22-471f-a77e-a06f9ad36ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:40.689359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb3e2-ed22-471f-a77e-a06f9ad36ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:40.689832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb3e2-ed22-471f-a77e-a06f9ad36ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:40.690813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebb3e2-ed22-471f-a77e-a06f9ad36ec1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:40.691349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebb3e2-ed22-471f-a77e-a06f9ad36ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:40.693006 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebb3e2-ed22-471f-a77e-a06f9ad36ec1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:40.702586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 244/490] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:40.708366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb3e2-ed22-471f-a77e-a06f9ad36ec1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:40.746326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6dc59-2802-492e-a042-751cae10016b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:40.752210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:40.767779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:40.822894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af760eb6-3680-4f07-980b-6dd7c0162527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:40.823730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760eb6-3680-4f07-980b-6dd7c0162527 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:40.824082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760eb6-3680-4f07-980b-6dd7c0162527 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:40.824355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760eb6-3680-4f07-980b-6dd7c0162527 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:40.840034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af760eb6-3680-4f07-980b-6dd7c0162527 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:40.840034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af760eb6-3680-4f07-980b-6dd7c0162527 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:40.869504 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb3e2-ed22-471f-a77e-a06f9ad36ec1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-af760eb6-3680-4f07-980b-6dd7c0162527 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:40.873153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:40.874054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:40.874925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:40.874925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:40.874925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:40.874925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:40.874925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:40.874925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:40.874925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:40.874925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:40.874925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:15:40.874925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:40.878957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 247/491] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 4 18:15:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:40.879834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af760eb6-3680-4f07-980b-6dd7c0162527 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:40.941166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0bb3f-7ce1-402b-a760-d7ffb447a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:40.942033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0bb3f-7ce1-402b-a760-d7ffb447a41c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:40.942311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0bb3f-7ce1-402b-a760-d7ffb447a41c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:40.942585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0bb3f-7ce1-402b-a760-d7ffb447a41c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:40.958327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0bb3f-7ce1-402b-a760-d7ffb447a41c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:40.959987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0bb3f-7ce1-402b-a760-d7ffb447a41c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7fe0bb3f-7ce1-402b-a760-d7ffb447a41c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:40.993534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:40.994447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:40.995291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:40.995291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:40.995291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:40.995291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:41.000798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 245/492] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:41.007720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0bb3f-7ce1-402b-a760-d7ffb447a41c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:41.029611 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af760eb6-3680-4f07-980b-6dd7c0162527 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:41.069924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedeb71d-6c8a-4e92-ae4a-2b68b4ffa602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:41.070602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb71d-6c8a-4e92-ae4a-2b68b4ffa602 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.070883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb71d-6c8a-4e92-ae4a-2b68b4ffa602 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.071159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb71d-6c8a-4e92-ae4a-2b68b4ffa602 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.072037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedeb71d-6c8a-4e92-ae4a-2b68b4ffa602 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:41.072349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedeb71d-6c8a-4e92-ae4a-2b68b4ffa602 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:41.073794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedeb71d-6c8a-4e92-ae4a-2b68b4ffa602 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:41.110002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 248/493] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 4 18:15:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:41.111397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2204-61da-4b35-8985-31fde7d28d65 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.111684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2204-61da-4b35-8985-31fde7d28d65 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.111958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2204-61da-4b35-8985-31fde7d28d65 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.117248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 249/494] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:41.117248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9631ae-662c-48e4-a7e5-ecb6a0c3d446 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.117248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9631ae-662c-48e4-a7e5-ecb6a0c3d446 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.117248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9631ae-662c-48e4-a7e5-ecb6a0c3d446 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.118729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:41.118804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 250/495] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:41.118804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9631ae-662c-48e4-a7e5-ecb6a0c3d446 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:41.139650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0bb3f-7ce1-402b-a760-d7ffb447a41c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:41.142745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:41.173288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e15d4-8fab-46d0-a8f1-8318f0098aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:41.173951 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e15d4-8fab-46d0-a8f1-8318f0098aca None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.174235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e15d4-8fab-46d0-a8f1-8318f0098aca None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.174515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e15d4-8fab-46d0-a8f1-8318f0098aca None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.175234 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e15d4-8fab-46d0-a8f1-8318f0098aca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:41.175518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e15d4-8fab-46d0-a8f1-8318f0098aca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:41.176942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e15d4-8fab-46d0-a8f1-8318f0098aca None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:41.189014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 246/496] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:41.190295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f483-702a-4a2f-b8ed-a0f2d1d76dbe None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.190585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f483-702a-4a2f-b8ed-a0f2d1d76dbe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.190856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f483-702a-4a2f-b8ed-a0f2d1d76dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.207227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b648f483-702a-4a2f-b8ed-a0f2d1d76dbe None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:41.208441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b648f483-702a-4a2f-b8ed-a0f2d1d76dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:41.219184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9631ae-662c-48e4-a7e5-ecb6a0c3d446 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:41.253456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77187-dbca-4771-bd61-131c1f5670df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:41.254116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77187-dbca-4771-bd61-131c1f5670df None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.254403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77187-dbca-4771-bd61-131c1f5670df None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.254684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77187-dbca-4771-bd61-131c1f5670df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.276182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 247/497] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:41.277446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33198387-d9db-44c7-9c68-62c8bfabad45 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.277731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33198387-d9db-44c7-9c68-62c8bfabad45 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.278003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33198387-d9db-44c7-9c68-62c8bfabad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.293744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-33198387-d9db-44c7-9c68-62c8bfabad45 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:41.294831 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-33198387-d9db-44c7-9c68-62c8bfabad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:41.333573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b77187-dbca-4771-bd61-131c1f5670df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:41.335058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b77187-dbca-4771-bd61-131c1f5670df None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:41.359334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:41.363178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 248/498] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:41.364813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946d60-5359-49d6-8a78-722224cbf7bb None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.365103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946d60-5359-49d6-8a78-722224cbf7bb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.365376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946d60-5359-49d6-8a78-722224cbf7bb None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.366609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 249/499] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:41.367281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946d60-5359-49d6-8a78-722224cbf7bb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:41.370467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:41.442090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 251/500] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:41.443008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77187-dbca-4771-bd61-131c1f5670df None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:41.478973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946d60-5359-49d6-8a78-722224cbf7bb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:41.513201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0dcae-7bd5-4dd3-8bc4-6d5df076a9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:41.514033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0dcae-7bd5-4dd3-8bc4-6d5df076a9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.514331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0dcae-7bd5-4dd3-8bc4-6d5df076a9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.514645 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0dcae-7bd5-4dd3-8bc4-6d5df076a9c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.522364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0dcae-7bd5-4dd3-8bc4-6d5df076a9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:41.523840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0dcae-7bd5-4dd3-8bc4-6d5df076a9c6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-34f0dcae-7bd5-4dd3-8bc4-6d5df076a9c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:41.539311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:41.540449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:41.541319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 250/501] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:41.541865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6783fa-0a23-4303-97d7-b88fd6c2d87f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.542056 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6783fa-0a23-4303-97d7-b88fd6c2d87f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.542703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6783fa-0a23-4303-97d7-b88fd6c2d87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.552670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77187-dbca-4771-bd61-131c1f5670df None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:41.559458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7a6783fa-0a23-4303-97d7-b88fd6c2d87f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:41.560709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7a6783fa-0a23-4303-97d7-b88fd6c2d87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:41.574968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:41.587741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a3caf-1ba2-487a-a6d4-7214f84c0633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:41.588599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a3caf-1ba2-487a-a6d4-7214f84c0633 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.588881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a3caf-1ba2-487a-a6d4-7214f84c0633 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.589149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a3caf-1ba2-487a-a6d4-7214f84c0633 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.599235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a3caf-1ba2-487a-a6d4-7214f84c0633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-498a3caf-1ba2-487a-a6d4-7214f84c0633 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:41.606975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:41.608381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 252/502] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:41.609199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a3caf-1ba2-487a-a6d4-7214f84c0633 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:41.620439 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:41.632123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 251/503] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:41.632932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6783fa-0a23-4303-97d7-b88fd6c2d87f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:41.713154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a3caf-1ba2-487a-a6d4-7214f84c0633 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:41.738140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6783fa-0a23-4303-97d7-b88fd6c2d87f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:41.746793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b19e58-e1ef-4431-9a08-bf910002fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:41.747640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b19e58-e1ef-4431-9a08-bf910002fc1d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.747888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b19e58-e1ef-4431-9a08-bf910002fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.748380 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b19e58-e1ef-4431-9a08-bf910002fc1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.758909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b19e58-e1ef-4431-9a08-bf910002fc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-49b19e58-e1ef-4431-9a08-bf910002fc1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:41.767216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:41.768231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:41.769016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 253/504] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:41.769659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b19e58-e1ef-4431-9a08-bf910002fc1d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:41.777078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6e5fd-a6e3-4693-99a5-eb67cad92b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:41.777877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6e5fd-a6e3-4693-99a5-eb67cad92b40 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.778157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6e5fd-a6e3-4693-99a5-eb67cad92b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.778425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6e5fd-a6e3-4693-99a5-eb67cad92b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.789959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6e5fd-a6e3-4693-99a5-eb67cad92b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:41.791436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6e5fd-a6e3-4693-99a5-eb67cad92b40 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-eca6e5fd-a6e3-4693-99a5-eb67cad92b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:41.810060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:41.811247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:41.812427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:41.812427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:41.812427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:41.812427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:41.812427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 252/505] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:41.812711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6e5fd-a6e3-4693-99a5-eb67cad92b40 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:41.819589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:41.858634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:41.876854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b19e58-e1ef-4431-9a08-bf910002fc1d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:41.908534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d20c15-b3e6-4f78-92f1-c08e8c4b3c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:41.909199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20c15-b3e6-4f78-92f1-c08e8c4b3c7a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.909479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20c15-b3e6-4f78-92f1-c08e8c4b3c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.909755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20c15-b3e6-4f78-92f1-c08e8c4b3c7a None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.910599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d20c15-b3e6-4f78-92f1-c08e8c4b3c7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:41.910925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d20c15-b3e6-4f78-92f1-c08e8c4b3c7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:41.912379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d20c15-b3e6-4f78-92f1-c08e8c4b3c7a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:41.916455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6e5fd-a6e3-4693-99a5-eb67cad92b40 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:41.929765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 254/506] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 4 18:15:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:41.930575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d20c15-b3e6-4f78-92f1-c08e8c4b3c7a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:41.950382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f84d-8854-4171-b449-903240d571a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:41.951026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f84d-8854-4171-b449-903240d571a9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:41.951372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f84d-8854-4171-b449-903240d571a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:41.952153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f84d-8854-4171-b449-903240d571a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:41.952526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f84d-8854-4171-b449-903240d571a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:41.952830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f84d-8854-4171-b449-903240d571a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:41.954217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f84d-8854-4171-b449-903240d571a9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:41.966543 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 253/507] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:41.966543 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f84d-8854-4171-b449-903240d571a9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.025946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:42.028989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d20c15-b3e6-4f78-92f1-c08e8c4b3c7a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:42.063087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757539e1-de5b-4e3a-93a0-742ddf2e6ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:42.063860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757539e1-de5b-4e3a-93a0-742ddf2e6ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:42.064176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757539e1-de5b-4e3a-93a0-742ddf2e6ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:42.064457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757539e1-de5b-4e3a-93a0-742ddf2e6ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:42.070324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f84d-8854-4171-b449-903240d571a9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:42.074768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757539e1-de5b-4e3a-93a0-742ddf2e6ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:42.076381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757539e1-de5b-4e3a-93a0-742ddf2e6ee2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:42.078948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-757539e1-de5b-4e3a-93a0-742ddf2e6ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:42.095565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:42.096537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:42.097647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:42.097647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:42.097647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:42.097647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:42.097647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 255/508] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:42.097647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757539e1-de5b-4e3a-93a0-742ddf2e6ee2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.114273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196724e-825b-4a1e-b95d-5af5a1be4c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:42.114953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196724e-825b-4a1e-b95d-5af5a1be4c34 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:42.115233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196724e-825b-4a1e-b95d-5af5a1be4c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:42.115507 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196724e-825b-4a1e-b95d-5af5a1be4c34 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:42.116287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196724e-825b-4a1e-b95d-5af5a1be4c34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:42.116590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196724e-825b-4a1e-b95d-5af5a1be4c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:42.117986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196724e-825b-4a1e-b95d-5af5a1be4c34 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:42.126327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 254/509] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:42.127333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196724e-825b-4a1e-b95d-5af5a1be4c34 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.208699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757539e1-de5b-4e3a-93a0-742ddf2e6ee2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:42.247191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d93ff0-0217-49a9-9c17-079092152d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:42.247868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d93ff0-0217-49a9-9c17-079092152d71 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:42.248212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d93ff0-0217-49a9-9c17-079092152d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:42.248505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d93ff0-0217-49a9-9c17-079092152d71 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:42.249281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d93ff0-0217-49a9-9c17-079092152d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:42.249594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d93ff0-0217-49a9-9c17-079092152d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:42.250987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d93ff0-0217-49a9-9c17-079092152d71 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:42.263765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 256/510] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:42.264787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d93ff0-0217-49a9-9c17-079092152d71 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.280836 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:42.354526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196724e-825b-4a1e-b95d-5af5a1be4c34 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:42.369262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d93ff0-0217-49a9-9c17-079092152d71 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:42.391853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702a06f-1da7-444d-bded-aed3fed870c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:42.392555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702a06f-1da7-444d-bded-aed3fed870c4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:42.392836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702a06f-1da7-444d-bded-aed3fed870c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:42.393110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702a06f-1da7-444d-bded-aed3fed870c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:42.407894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b3e7-4e3d-4282-854d-fcb652204dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:42.408734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b3e7-4e3d-4282-854d-fcb652204dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:42.409021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b3e7-4e3d-4282-854d-fcb652204dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:42.409303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b3e7-4e3d-4282-854d-fcb652204dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:42.420303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15b3e7-4e3d-4282-854d-fcb652204dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:42.421773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15b3e7-4e3d-4282-854d-fcb652204dd0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:42.428479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6e15b3e7-4e3d-4282-854d-fcb652204dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:42.439330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:42.440222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:42.441033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:42.441033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:42.441033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:42.441033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:42.441033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 257/511] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:42.441902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b3e7-4e3d-4282-854d-fcb652204dd0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.467083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702a06f-1da7-444d-bded-aed3fed870c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:42.468614 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702a06f-1da7-444d-bded-aed3fed870c4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:42.502048 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:42.539065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b3e7-4e3d-4282-854d-fcb652204dd0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:42.566713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 255/512] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:42.567546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702a06f-1da7-444d-bded-aed3fed870c4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.576372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a6c33-3100-4c25-9b8f-859f1834308d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:42.577223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a6c33-3100-4c25-9b8f-859f1834308d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:42.577515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a6c33-3100-4c25-9b8f-859f1834308d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:42.577789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a6c33-3100-4c25-9b8f-859f1834308d None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:42.578517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a6c33-3100-4c25-9b8f-859f1834308d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:42.578815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a6c33-3100-4c25-9b8f-859f1834308d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:42.580211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a6c33-3100-4c25-9b8f-859f1834308d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:42.591678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 258/513] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:42.592790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a6c33-3100-4c25-9b8f-859f1834308d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.638664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:42.673420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702a06f-1da7-444d-bded-aed3fed870c4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:42.688133 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a6c33-3100-4c25-9b8f-859f1834308d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:42.706837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226116-8c3a-4fdc-86ba-192e39637dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:42.707632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226116-8c3a-4fdc-86ba-192e39637dac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:42.707905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226116-8c3a-4fdc-86ba-192e39637dac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:42.708205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226116-8c3a-4fdc-86ba-192e39637dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:42.710869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:42.718711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55226116-8c3a-4fdc-86ba-192e39637dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:42.720184 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55226116-8c3a-4fdc-86ba-192e39637dac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:42.722398 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311381d-0514-419e-8fdb-d61fe5c8058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:42.723196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311381d-0514-419e-8fdb-d61fe5c8058c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:42.723472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311381d-0514-419e-8fdb-d61fe5c8058c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:42.723824 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311381d-0514-419e-8fdb-d61fe5c8058c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:42.730804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311381d-0514-419e-8fdb-d61fe5c8058c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:42.732276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311381d-0514-419e-8fdb-d61fe5c8058c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-55226116-8c3a-4fdc-86ba-192e39637dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:42.737272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:42.738083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:42.739949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:42.739949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:42.739949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:42.739949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:42.739949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 256/514] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:42.739949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226116-8c3a-4fdc-86ba-192e39637dac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2311381d-0514-419e-8fdb-d61fe5c8058c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:42.749371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:42.750573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:42.751680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:42.751680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:42.751680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:42.751680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:42.751680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:42.751680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:42.751680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:42.751680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:42.751680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 259/515] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:42.751680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311381d-0514-419e-8fdb-d61fe5c8058c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.841175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226116-8c3a-4fdc-86ba-192e39637dac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:42.853332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311381d-0514-419e-8fdb-d61fe5c8058c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:42.859888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:42.874449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a0954-bc94-4652-a574-5411590ed931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:42.875111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a0954-bc94-4652-a574-5411590ed931 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:42.875386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a0954-bc94-4652-a574-5411590ed931 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:42.875653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a0954-bc94-4652-a574-5411590ed931 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:42.876403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a0954-bc94-4652-a574-5411590ed931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:42.876700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a0954-bc94-4652-a574-5411590ed931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:42.878085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a0954-bc94-4652-a574-5411590ed931 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:42.887217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564d01e-4a71-4737-b5b6-63efa6631aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:42.888024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d01e-4a71-4737-b5b6-63efa6631aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:42.888327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d01e-4a71-4737-b5b6-63efa6631aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:42.888599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564d01e-4a71-4737-b5b6-63efa6631aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:42.889665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 257/516] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:42.890356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a0954-bc94-4652-a574-5411590ed931 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.900548 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564d01e-4a71-4737-b5b6-63efa6631aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:42.901999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564d01e-4a71-4737-b5b6-63efa6631aa2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8564d01e-4a71-4737-b5b6-63efa6631aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:42.919989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:42.921055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:42.921880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:42.921880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:42.921880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:42.921880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:42.921880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 260/517] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:42.922129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564d01e-4a71-4737-b5b6-63efa6631aa2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:42.956935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:42.994979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a0954-bc94-4652-a574-5411590ed931 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.021545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564d01e-4a71-4737-b5b6-63efa6631aa2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.030079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46fc6-3ef5-4c56-8fc7-02028ff0da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.030758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46fc6-3ef5-4c56-8fc7-02028ff0da15 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.031041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46fc6-3ef5-4c56-8fc7-02028ff0da15 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.031321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46fc6-3ef5-4c56-8fc7-02028ff0da15 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.032045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe46fc6-3ef5-4c56-8fc7-02028ff0da15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:43.033504 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe46fc6-3ef5-4c56-8fc7-02028ff0da15 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:43.054156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 258/518] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:15:42 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:15:43.056469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26efc70-e393-461f-bc7f-807ab4ee7ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.057217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26efc70-e393-461f-bc7f-807ab4ee7ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.057499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26efc70-e393-461f-bc7f-807ab4ee7ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.057774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26efc70-e393-461f-bc7f-807ab4ee7ba7 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.058508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26efc70-e393-461f-bc7f-807ab4ee7ba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:43.058840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26efc70-e393-461f-bc7f-807ab4ee7ba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:43.060288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26efc70-e393-461f-bc7f-807ab4ee7ba7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:43.061177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46fc6-3ef5-4c56-8fc7-02028ff0da15 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:43.078945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 261/519] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:43.078945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26efc70-e393-461f-bc7f-807ab4ee7ba7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:43.107998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:43.181519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:43.184226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46fc6-3ef5-4c56-8fc7-02028ff0da15 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.187686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26efc70-e393-461f-bc7f-807ab4ee7ba7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.225573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b258d4-cb46-4789-8a3b-b9f9718f78fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.226250 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b258d4-cb46-4789-8a3b-b9f9718f78fa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.226529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b258d4-cb46-4789-8a3b-b9f9718f78fa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.226802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b258d4-cb46-4789-8a3b-b9f9718f78fa None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.227172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffba5d-62ab-4ff4-bdcf-2bb80f151af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.227603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b258d4-cb46-4789-8a3b-b9f9718f78fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:43.227916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b258d4-cb46-4789-8a3b-b9f9718f78fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:43.228119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffba5d-62ab-4ff4-bdcf-2bb80f151af4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.228410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffba5d-62ab-4ff4-bdcf-2bb80f151af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.228678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffba5d-62ab-4ff4-bdcf-2bb80f151af4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.229403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b258d4-cb46-4789-8a3b-b9f9718f78fa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:43.237425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffba5d-62ab-4ff4-bdcf-2bb80f151af4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:43.238959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffba5d-62ab-4ff4-bdcf-2bb80f151af4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:43.254675 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 259/520] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:43.254675 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b258d4-cb46-4789-8a3b-b9f9718f78fa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e9ffba5d-62ab-4ff4-bdcf-2bb80f151af4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:43.254914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:43.255715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:43.256645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 262/521] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:43.257196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffba5d-62ab-4ff4-bdcf-2bb80f151af4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:43.364419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:43.368689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffba5d-62ab-4ff4-bdcf-2bb80f151af4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.371095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b258d4-cb46-4789-8a3b-b9f9718f78fa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.405919 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951ff75-1157-43ac-92b9-57309b81730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.406515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c396243-bbd2-4cbc-9334-650e658e59bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.406727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951ff75-1157-43ac-92b9-57309b81730c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.407007 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951ff75-1157-43ac-92b9-57309b81730c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.407186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396243-bbd2-4cbc-9334-650e658e59bc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.407279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951ff75-1157-43ac-92b9-57309b81730c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.407462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396243-bbd2-4cbc-9334-650e658e59bc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.407739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396243-bbd2-4cbc-9334-650e658e59bc None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.408502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c396243-bbd2-4cbc-9334-650e658e59bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:43.408813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c396243-bbd2-4cbc-9334-650e658e59bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:43.410200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c396243-bbd2-4cbc-9334-650e658e59bc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:43.414669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951ff75-1157-43ac-92b9-57309b81730c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:43.416145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951ff75-1157-43ac-92b9-57309b81730c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:43.426982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 260/522] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:43.426982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c396243-bbd2-4cbc-9334-650e658e59bc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f951ff75-1157-43ac-92b9-57309b81730c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:43.436382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:43.437475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:43.438572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:43.438572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:43.438572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:43.438572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:43.438572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:43.438572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:43.438572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:43.438572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:43.438572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 18:15:43.438572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:43.439552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 263/523] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:43.440275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951ff75-1157-43ac-92b9-57309b81730c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:43.458647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:43.539496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c396243-bbd2-4cbc-9334-650e658e59bc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.542671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951ff75-1157-43ac-92b9-57309b81730c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.574779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6362cc-4c43-4fbb-982d-01bc60aa54f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.575685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6362cc-4c43-4fbb-982d-01bc60aa54f5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.575973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6362cc-4c43-4fbb-982d-01bc60aa54f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.576341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6362cc-4c43-4fbb-982d-01bc60aa54f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.577341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6362cc-4c43-4fbb-982d-01bc60aa54f5 None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=311b3c1e00d64423865b35a188ede79a) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:43.577714 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6362cc-4c43-4fbb-982d-01bc60aa54f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:43.579137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6362cc-4c43-4fbb-982d-01bc60aa54f5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:43.579627 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8278-5bff-42dc-a23c-a4921e3eac58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.580338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8278-5bff-42dc-a23c-a4921e3eac58 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.580624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8278-5bff-42dc-a23c-a4921e3eac58 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.581018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8278-5bff-42dc-a23c-a4921e3eac58 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.581979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8278-5bff-42dc-a23c-a4921e3eac58 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:43.582289 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8278-5bff-42dc-a23c-a4921e3eac58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:43.583742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8278-5bff-42dc-a23c-a4921e3eac58 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:43.596362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 261/524] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:43 2022] GET /identity/v3/role_assignments?user.id=311b3c1e00d64423865b35a188ede79a&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:43.596362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6362cc-4c43-4fbb-982d-01bc60aa54f5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:43.618584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:43.619701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 264/525] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Jun 4 18:15:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:43.620817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8278-5bff-42dc-a23c-a4921e3eac58 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:43.708047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:43.732117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6362cc-4c43-4fbb-982d-01bc60aa54f5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.741570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8278-5bff-42dc-a23c-a4921e3eac58 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.778961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c4b84-9d43-4295-b47c-ace5cbe7f3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.779818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4b84-9d43-4295-b47c-ace5cbe7f3ec None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.780134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4b84-9d43-4295-b47c-ace5cbe7f3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.780134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c4b84-9d43-4295-b47c-ace5cbe7f3ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.781715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90efdd-e061-4478-a18a-92247ab00c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.782643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90efdd-e061-4478-a18a-92247ab00c8c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.783076 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90efdd-e061-4478-a18a-92247ab00c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.783554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90efdd-e061-4478-a18a-92247ab00c8c None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.784914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90efdd-e061-4478-a18a-92247ab00c8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:43.785237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90efdd-e061-4478-a18a-92247ab00c8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:43.786793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90efdd-e061-4478-a18a-92247ab00c8c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:43.793274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c4b84-9d43-4295-b47c-ace5cbe7f3ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:43.795156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c4b84-9d43-4295-b47c-ace5cbe7f3ec None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-813c4b84-9d43-4295-b47c-ace5cbe7f3ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:43.812555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:43.813548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:43.814384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:43.814384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:43.814384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:43.814384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:43.814384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:43.814384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:43.814384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:43.814384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:43.816355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 265/526] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 4 18:15:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:43.816995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90efdd-e061-4478-a18a-92247ab00c8c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:43.817337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 262/527] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:43.821772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c4b84-9d43-4295-b47c-ace5cbe7f3ec None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:43.931153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:43.942475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90efdd-e061-4478-a18a-92247ab00c8c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.953643 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c4b84-9d43-4295-b47c-ace5cbe7f3ec None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:43.980969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:43.990158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01685089-eb7f-4d1c-a5cd-9f18b07fa5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.990826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685089-eb7f-4d1c-a5cd-9f18b07fa5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.991108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685089-eb7f-4d1c-a5cd-9f18b07fa5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.991384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685089-eb7f-4d1c-a5cd-9f18b07fa5f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:43.994597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98675eba-0d80-4bf6-a7d9-ee193f626408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:43.995247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98675eba-0d80-4bf6-a7d9-ee193f626408 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:43.995530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98675eba-0d80-4bf6-a7d9-ee193f626408 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:43.995804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98675eba-0d80-4bf6-a7d9-ee193f626408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:44.073098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98675eba-0d80-4bf6-a7d9-ee193f626408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:44.074600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98675eba-0d80-4bf6-a7d9-ee193f626408 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:44.085908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01685089-eb7f-4d1c-a5cd-9f18b07fa5f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:44.088392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01685089-eb7f-4d1c-a5cd-9f18b07fa5f2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:44.168615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:44.195806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 263/528] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:44.196619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98675eba-0d80-4bf6-a7d9-ee193f626408 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:44.231992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 266/529] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:44.232979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01685089-eb7f-4d1c-a5cd-9f18b07fa5f2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:44.264655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:44.324573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98675eba-0d80-4bf6-a7d9-ee193f626408 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:44.343422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01685089-eb7f-4d1c-a5cd-9f18b07fa5f2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:44.369488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef064b6b-6399-4d2d-8731-555a4785a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:44.370902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064b6b-6399-4d2d-8731-555a4785a07a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:44.371388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064b6b-6399-4d2d-8731-555a4785a07a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:44.372089 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064b6b-6399-4d2d-8731-555a4785a07a None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:44.373322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef064b6b-6399-4d2d-8731-555a4785a07a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:44.373811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef064b6b-6399-4d2d-8731-555a4785a07a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:44.376172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef064b6b-6399-4d2d-8731-555a4785a07a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:44.378718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c560cf7-89ff-4dfa-9988-b3d678bd065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:44.379817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560cf7-89ff-4dfa-9988-b3d678bd065b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:44.379925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560cf7-89ff-4dfa-9988-b3d678bd065b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:44.380156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c560cf7-89ff-4dfa-9988-b3d678bd065b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:44.392302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c560cf7-89ff-4dfa-9988-b3d678bd065b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:44.393783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c560cf7-89ff-4dfa-9988-b3d678bd065b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:44.395013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 264/530] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:44.396265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef064b6b-6399-4d2d-8731-555a4785a07a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7c560cf7-89ff-4dfa-9988-b3d678bd065b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:44.414492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:44.415424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:44.416306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:44.416306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:44.416306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:44.416306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:44.416306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 267/531] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:44.417692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c560cf7-89ff-4dfa-9988-b3d678bd065b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:44.455643 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:44.527686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:44.532174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef064b6b-6399-4d2d-8731-555a4785a07a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:44.553032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c560cf7-89ff-4dfa-9988-b3d678bd065b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:44.573823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55becb-9236-40ef-8e1f-e0a7cf97ad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:44.575133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55becb-9236-40ef-8e1f-e0a7cf97ad60 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:44.575558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55becb-9236-40ef-8e1f-e0a7cf97ad60 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:44.575969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55becb-9236-40ef-8e1f-e0a7cf97ad60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:44.589846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55becb-9236-40ef-8e1f-e0a7cf97ad60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:44.591891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55becb-9236-40ef-8e1f-e0a7cf97ad60 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:44.594110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b3710-1a00-40a4-b22e-546c820cfc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:44.595260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b3710-1a00-40a4-b22e-546c820cfc2d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:44.595637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b3710-1a00-40a4-b22e-546c820cfc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:44.596038 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b3710-1a00-40a4-b22e-546c820cfc2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:44.597025 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b3710-1a00-40a4-b22e-546c820cfc2d None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=3b4adc107bf542b8bb0502c7fbf94431) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:44.597451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b3710-1a00-40a4-b22e-546c820cfc2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:44.598987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b3710-1a00-40a4-b22e-546c820cfc2d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:44.612034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 268/532] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:44 2022] GET /identity/v3/role_assignments?user.id=3b4adc107bf542b8bb0502c7fbf94431&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:44.612034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b3710-1a00-40a4-b22e-546c820cfc2d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-fd55becb-9236-40ef-8e1f-e0a7cf97ad60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:44.616605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:44.617483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:44.618319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:44.618319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:44.618319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:44.618319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:44.618319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 265/533] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:44.627211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55becb-9236-40ef-8e1f-e0a7cf97ad60 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:44.777625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b3710-1a00-40a4-b22e-546c820cfc2d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:44.815824 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cad224-ebb3-4f1e-bb3c-245ad1b43517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:44.816539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:44.817720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cad224-ebb3-4f1e-bb3c-245ad1b43517 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:44.818197 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cad224-ebb3-4f1e-bb3c-245ad1b43517 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:44.818685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cad224-ebb3-4f1e-bb3c-245ad1b43517 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:44.819613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cad224-ebb3-4f1e-bb3c-245ad1b43517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:44.820166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cad224-ebb3-4f1e-bb3c-245ad1b43517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:44.821833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cad224-ebb3-4f1e-bb3c-245ad1b43517 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:44.835302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 269/534] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:44.843674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55becb-9236-40ef-8e1f-e0a7cf97ad60 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:44.850322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cad224-ebb3-4f1e-bb3c-245ad1b43517 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:44.867304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:44.878536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37761c0c-79ff-4e55-8afa-7ec94a06c002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:44.879138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37761c0c-79ff-4e55-8afa-7ec94a06c002 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:44.879425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37761c0c-79ff-4e55-8afa-7ec94a06c002 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:44.879705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37761c0c-79ff-4e55-8afa-7ec94a06c002 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:44.880488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37761c0c-79ff-4e55-8afa-7ec94a06c002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:44.880799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37761c0c-79ff-4e55-8afa-7ec94a06c002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:44.882233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37761c0c-79ff-4e55-8afa-7ec94a06c002 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:44.896311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 266/535] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:44.904054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37761c0c-79ff-4e55-8afa-7ec94a06c002 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:45.004353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cad224-ebb3-4f1e-bb3c-245ad1b43517 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:45.049316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb46568-6948-4958-a27f-919615a3482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:45.050156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb46568-6948-4958-a27f-919615a3482d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:45.050441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb46568-6948-4958-a27f-919615a3482d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:45.050714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb46568-6948-4958-a27f-919615a3482d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:45.059586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb46568-6948-4958-a27f-919615a3482d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:45.062393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb46568-6948-4958-a27f-919615a3482d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-acb46568-6948-4958-a27f-919615a3482d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:45.082042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:45.082907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:45.084322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:45.084322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:45.084322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:45.084322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:45.084322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:45.084322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:45.084322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:45.084322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:45.084322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 270/536] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:45.091954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb46568-6948-4958-a27f-919615a3482d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:45.103853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37761c0c-79ff-4e55-8afa-7ec94a06c002 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:45.173364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:45.192863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1f36-f9f1-46c5-b356-18cec23c1eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:45.193696 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1f36-f9f1-46c5-b356-18cec23c1eca None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:45.193981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1f36-f9f1-46c5-b356-18cec23c1eca None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:45.194256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1f36-f9f1-46c5-b356-18cec23c1eca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:45.209139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1f36-f9f1-46c5-b356-18cec23c1eca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:45.210625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1f36-f9f1-46c5-b356-18cec23c1eca None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:45.212030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb46568-6948-4958-a27f-919615a3482d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-056e1f36-f9f1-46c5-b356-18cec23c1eca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:45.244107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:45.245230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:45.246355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:45.246355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:45.246355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:45.246355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:45.246355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:45.246355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:45.246355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:45.246355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:45.252034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 267/537] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:45.253048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1f36-f9f1-46c5-b356-18cec23c1eca None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:45.267394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7c6d3-f04f-4b0b-91e9-28f8ac4019fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:45.268108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7c6d3-f04f-4b0b-91e9-28f8ac4019fa None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:45.268394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7c6d3-f04f-4b0b-91e9-28f8ac4019fa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:45.268670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7c6d3-f04f-4b0b-91e9-28f8ac4019fa None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:45.269494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7c6d3-f04f-4b0b-91e9-28f8ac4019fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:45.269803 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7c6d3-f04f-4b0b-91e9-28f8ac4019fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:45.271334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7c6d3-f04f-4b0b-91e9-28f8ac4019fa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:45.288620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:45.302236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 271/538] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:45.308291 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7c6d3-f04f-4b0b-91e9-28f8ac4019fa None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:45.419164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1f36-f9f1-46c5-b356-18cec23c1eca None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:45.461376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833581a-7baa-4789-a1c7-69e4ddd5977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:45.462466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833581a-7baa-4789-a1c7-69e4ddd5977b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:45.462937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833581a-7baa-4789-a1c7-69e4ddd5977b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:45.463432 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833581a-7baa-4789-a1c7-69e4ddd5977b None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:45.464557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833581a-7baa-4789-a1c7-69e4ddd5977b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:45.465148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833581a-7baa-4789-a1c7-69e4ddd5977b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:45.466771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833581a-7baa-4789-a1c7-69e4ddd5977b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:45.480054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 268/539] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:45.481646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41f5e-42ec-41e6-a4ec-4cf8e2bbe015 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:45.481900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7c6d3-f04f-4b0b-91e9-28f8ac4019fa None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:45.482122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41f5e-42ec-41e6-a4ec-4cf8e2bbe015 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:45.482662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41f5e-42ec-41e6-a4ec-4cf8e2bbe015 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:45.484279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 269/540] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:45.489422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f41f5e-42ec-41e6-a4ec-4cf8e2bbe015 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:45.514106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:45.525619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb194a-3a10-44b5-b8ba-e7873e95b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:45.526368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb194a-3a10-44b5-b8ba-e7873e95b2ab None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:45.526653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb194a-3a10-44b5-b8ba-e7873e95b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:45.526929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb194a-3a10-44b5-b8ba-e7873e95b2ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:45.527770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb194a-3a10-44b5-b8ba-e7873e95b2ab None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=43023787db0749e8be546755f521755b) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:45.528125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb194a-3a10-44b5-b8ba-e7873e95b2ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:45.530135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb194a-3a10-44b5-b8ba-e7873e95b2ab None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:45.538021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 272/541] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:45 2022] GET /identity/v3/role_assignments?user.id=43023787db0749e8be546755f521755b&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:45.539803 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65be87-b61d-449c-8e86-4862b0f7fbc9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:45.546793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65be87-b61d-449c-8e86-4862b0f7fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:45.547166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65be87-b61d-449c-8e86-4862b0f7fbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:45.567339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0b65be87-b61d-449c-8e86-4862b0f7fbc9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:45.568598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0b65be87-b61d-449c-8e86-4862b0f7fbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:45.584648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:45.643702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f41f5e-42ec-41e6-a4ec-4cf8e2bbe015 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:45.657765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 273/542] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:45.694629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65be87-b61d-449c-8e86-4862b0f7fbc9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:45.709388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4a47e-7aa4-409a-b2c4-2c03e8e06e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:45.710077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4a47e-7aa4-409a-b2c4-2c03e8e06e21 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:45.710358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4a47e-7aa4-409a-b2c4-2c03e8e06e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:45.710633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4a47e-7aa4-409a-b2c4-2c03e8e06e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:45.711495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4a47e-7aa4-409a-b2c4-2c03e8e06e21 None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=37c4400204794a54957ccf28df938f46) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:45.711807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4a47e-7aa4-409a-b2c4-2c03e8e06e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:45.713346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4a47e-7aa4-409a-b2c4-2c03e8e06e21 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:45.727521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 270/543] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:45 2022] GET /identity/v3/role_assignments?user.id=37c4400204794a54957ccf28df938f46&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:45.866755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65be87-b61d-449c-8e86-4862b0f7fbc9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:45.893451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:45.907009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5e75c-6f25-4828-89d5-53e82742345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:45.908112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e75c-6f25-4828-89d5-53e82742345c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:45.908392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e75c-6f25-4828-89d5-53e82742345c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:45.908663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5e75c-6f25-4828-89d5-53e82742345c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:45.921082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5e75c-6f25-4828-89d5-53e82742345c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-0fb5e75c-6f25-4828-89d5-53e82742345c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:45.928997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:45.929925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:45.930711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 274/544] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:45.938044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4a47e-7aa4-409a-b2c4-2c03e8e06e21 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:46.049275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4a47e-7aa4-409a-b2c4-2c03e8e06e21 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:46.051055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecbe2e-de39-4245-b73f-3da9ae875b20 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:46.051371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecbe2e-de39-4245-b73f-3da9ae875b20 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:46.051600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecbe2e-de39-4245-b73f-3da9ae875b20 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:46.053347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 275/545] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:46.058486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6ca68-ec74-4c80-b804-a95bb1a93b43 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:46.058774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6ca68-ec74-4c80-b804-a95bb1a93b43 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:46.059051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6ca68-ec74-4c80-b804-a95bb1a93b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:46.076893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-eac6ca68-ec74-4c80-b804-a95bb1a93b43 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:46.078335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eac6ca68-ec74-4c80-b804-a95bb1a93b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:46.086885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5055-842f-4f67-9898-f1a99677a5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:46.087878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5055-842f-4f67-9898-f1a99677a5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:46.088402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5055-842f-4f67-9898-f1a99677a5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:46.088891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5055-842f-4f67-9898-f1a99677a5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:46.089818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d5055-842f-4f67-9898-f1a99677a5a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:46.090299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d5055-842f-4f67-9898-f1a99677a5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:46.091901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d5055-842f-4f67-9898-f1a99677a5a5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:46.094612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:46.101804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 271/546] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:46.109204 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5055-842f-4f67-9898-f1a99677a5a5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:46.190522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 276/547] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:46.242891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6ca68-ec74-4c80-b804-a95bb1a93b43 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:46.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5055-842f-4f67-9898-f1a99677a5a5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:46.358113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9106ac-a469-491d-815b-8fd8ac591021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:46.358892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9106ac-a469-491d-815b-8fd8ac591021 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:46.359172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9106ac-a469-491d-815b-8fd8ac591021 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:46.359444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9106ac-a469-491d-815b-8fd8ac591021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:46.370228 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9106ac-a469-491d-815b-8fd8ac591021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:46.371783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9106ac-a469-491d-815b-8fd8ac591021 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:46.381575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6ca68-ec74-4c80-b804-a95bb1a93b43 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ed9106ac-a469-491d-815b-8fd8ac591021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:46.390583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:46.391491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:46.392346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:46.392346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:46.392346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:46.392346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:46.392346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 272/548] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:46.396765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:46.397519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9106ac-a469-491d-815b-8fd8ac591021 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:46.430565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a2771-2746-463f-b403-b22cc158e0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:46.431393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a2771-2746-463f-b403-b22cc158e0ee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:46.431676 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a2771-2746-463f-b403-b22cc158e0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:46.431953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a2771-2746-463f-b403-b22cc158e0ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:46.450182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:46.454468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a2771-2746-463f-b403-b22cc158e0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3c5a2771-2746-463f-b403-b22cc158e0ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:46.470434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:46.473098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:46.475181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 277/549] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:46.482605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a2771-2746-463f-b403-b22cc158e0ee None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:46.506247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9106ac-a469-491d-815b-8fd8ac591021 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:46.549253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602960b2-c67d-40ee-b414-af4dd53b086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:46.549995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602960b2-c67d-40ee-b414-af4dd53b086c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:46.550278 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602960b2-c67d-40ee-b414-af4dd53b086c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:46.550585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602960b2-c67d-40ee-b414-af4dd53b086c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:46.551330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602960b2-c67d-40ee-b414-af4dd53b086c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:46.551641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602960b2-c67d-40ee-b414-af4dd53b086c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:46.553062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602960b2-c67d-40ee-b414-af4dd53b086c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:46.577414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 273/550] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:15:46.582776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602960b2-c67d-40ee-b414-af4dd53b086c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:46.620877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a2771-2746-463f-b403-b22cc158e0ee None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:46.665632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517b05-7fa4-4976-a454-d734cd437b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:46.666330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517b05-7fa4-4976-a454-d734cd437b18 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:46.666616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517b05-7fa4-4976-a454-d734cd437b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:46.666896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517b05-7fa4-4976-a454-d734cd437b18 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:46.668038 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c517b05-7fa4-4976-a454-d734cd437b18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:46.668415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c517b05-7fa4-4976-a454-d734cd437b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:46.669831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c517b05-7fa4-4976-a454-d734cd437b18 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:46.686318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602960b2-c67d-40ee-b414-af4dd53b086c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:46.692731 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 278/551] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:46.693901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517b05-7fa4-4976-a454-d734cd437b18 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:46.698430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:46.724880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c68ab-7a45-4855-a609-d1c6471047a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:46.725689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c68ab-7a45-4855-a609-d1c6471047a2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:46.725969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c68ab-7a45-4855-a609-d1c6471047a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:46.726242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c68ab-7a45-4855-a609-d1c6471047a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:46.734496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c68ab-7a45-4855-a609-d1c6471047a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:46.735967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c68ab-7a45-4855-a609-d1c6471047a2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:46.737821 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0b2c68ab-7a45-4855-a609-d1c6471047a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:46.751364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:46.753661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:46.755924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 274/552] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:15:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:46.760043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c68ab-7a45-4855-a609-d1c6471047a2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:46.812072 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517b05-7fa4-4976-a454-d734cd437b18 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:46.848856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb39d9-0643-4cfe-a955-23b063e94730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:46.849582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb39d9-0643-4cfe-a955-23b063e94730 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:46.849859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb39d9-0643-4cfe-a955-23b063e94730 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:46.850130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb39d9-0643-4cfe-a955-23b063e94730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:46.862952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb39d9-0643-4cfe-a955-23b063e94730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:46.864502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb39d9-0643-4cfe-a955-23b063e94730 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-94cb39d9-0643-4cfe-a955-23b063e94730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:46.882778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:46.885309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:46.887348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:46.887348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:46.887348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:46.887348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:46.887348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 279/553] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:46.897496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb39d9-0643-4cfe-a955-23b063e94730 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:46.942795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c68ab-7a45-4855-a609-d1c6471047a2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:46.992307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:47.010583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb39d9-0643-4cfe-a955-23b063e94730 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:47.024739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aca0b-c0c2-4a0c-8f06-21447eeb4229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:47.025441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aca0b-c0c2-4a0c-8f06-21447eeb4229 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:47.025726 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aca0b-c0c2-4a0c-8f06-21447eeb4229 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:47.026004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130aca0b-c0c2-4a0c-8f06-21447eeb4229 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:47.026868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aca0b-c0c2-4a0c-8f06-21447eeb4229 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:47.027169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aca0b-c0c2-4a0c-8f06-21447eeb4229 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:47.028719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130aca0b-c0c2-4a0c-8f06-21447eeb4229 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:47.053334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2f212-0e8e-4263-bde4-ac5ec955834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:47.054459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2f212-0e8e-4263-bde4-ac5ec955834b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:47.056486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2f212-0e8e-4263-bde4-ac5ec955834b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:47.056778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2f212-0e8e-4263-bde4-ac5ec955834b None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:47.057545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2f212-0e8e-4263-bde4-ac5ec955834b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:47.057862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2f212-0e8e-4263-bde4-ac5ec955834b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:47.059277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2f212-0e8e-4263-bde4-ac5ec955834b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:47.092798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 280/554] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:47.099119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2f212-0e8e-4263-bde4-ac5ec955834b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:47.116101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 275/555] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 4 18:15:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:47.121829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aca0b-c0c2-4a0c-8f06-21447eeb4229 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:47.188976 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:47.224315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2f212-0e8e-4263-bde4-ac5ec955834b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:47.266272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98c960-6556-4e26-a002-0b1a6f54159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:47.273230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98c960-6556-4e26-a002-0b1a6f54159b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:47.273768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98c960-6556-4e26-a002-0b1a6f54159b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:47.274242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98c960-6556-4e26-a002-0b1a6f54159b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:47.283642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98c960-6556-4e26-a002-0b1a6f54159b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:47.285464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98c960-6556-4e26-a002-0b1a6f54159b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ba98c960-6556-4e26-a002-0b1a6f54159b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:47.302653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:47.303701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:47.305082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:47.305082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:47.305082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:47.305082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:47.305082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:47.305082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:47.305082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:47.305082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:47.305082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:15:47.305082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:47.310183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 281/556] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 4 18:15:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:47.315412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98c960-6556-4e26-a002-0b1a6f54159b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:47.330064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130aca0b-c0c2-4a0c-8f06-21447eeb4229 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:47.330987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:47.375162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613f00a-576f-4840-aab6-3b617a16a566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:47.376208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613f00a-576f-4840-aab6-3b617a16a566 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:47.376692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613f00a-576f-4840-aab6-3b617a16a566 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:47.377164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613f00a-576f-4840-aab6-3b617a16a566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:47.465946 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613f00a-576f-4840-aab6-3b617a16a566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:47.468991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613f00a-576f-4840-aab6-3b617a16a566 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:47.479100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98c960-6556-4e26-a002-0b1a6f54159b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:47.504499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:47.515210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deff46f-5356-4ccc-9c10-f0adb0c9bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:47.515913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deff46f-5356-4ccc-9c10-f0adb0c9bcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:47.516232 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deff46f-5356-4ccc-9c10-f0adb0c9bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:47.516505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deff46f-5356-4ccc-9c10-f0adb0c9bcf3 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:47.517446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deff46f-5356-4ccc-9c10-f0adb0c9bcf3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:47.517756 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deff46f-5356-4ccc-9c10-f0adb0c9bcf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:47.519219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deff46f-5356-4ccc-9c10-f0adb0c9bcf3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:47.537770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 282/557] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 4 18:15:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:47.539130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc23cd-44e9-48c2-9da9-85f358fee12f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:47.539556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc23cd-44e9-48c2-9da9-85f358fee12f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:47.539771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc23cd-44e9-48c2-9da9-85f358fee12f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:47.545771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 283/558] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:47.546690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc23cd-44e9-48c2-9da9-85f358fee12f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:47.597205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 276/559] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 18:15:47.598511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a7b6d-559b-4968-81da-911fad1a2a95 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:47.598798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a7b6d-559b-4968-81da-911fad1a2a95 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:47.599073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a7b6d-559b-4968-81da-911fad1a2a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:47.615748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-042a7b6d-559b-4968-81da-911fad1a2a95 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:47.616960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-042a7b6d-559b-4968-81da-911fad1a2a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:47.637437 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:47.691000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc23cd-44e9-48c2-9da9-85f358fee12f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:47.696387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 277/560] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:47.697303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a7b6d-559b-4968-81da-911fad1a2a95 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:47.730813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e3447-0228-48d6-b6a6-65b03c89bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:47.732958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e3447-0228-48d6-b6a6-65b03c89bf89 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:47.733784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e3447-0228-48d6-b6a6-65b03c89bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:47.734276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e3447-0228-48d6-b6a6-65b03c89bf89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:47.749229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e3447-0228-48d6-b6a6-65b03c89bf89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:47.751056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e3447-0228-48d6-b6a6-65b03c89bf89 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:47.772270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-307e3447-0228-48d6-b6a6-65b03c89bf89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:47.775859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:47.777227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:47.778538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:47.778538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:47.778538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:47.778538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:47.778538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 284/561] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:47.778538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e3447-0228-48d6-b6a6-65b03c89bf89 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:47.840293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a7b6d-559b-4968-81da-911fad1a2a95 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:47.891995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44b609-c1a4-4120-aee8-dcbf085ecd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:47.893170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44b609-c1a4-4120-aee8-dcbf085ecd04 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:47.893430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e3447-0228-48d6-b6a6-65b03c89bf89 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:47.894276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44b609-c1a4-4120-aee8-dcbf085ecd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:47.895029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44b609-c1a4-4120-aee8-dcbf085ecd04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:47.909918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44b609-c1a4-4120-aee8-dcbf085ecd04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:47.911026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:47.913142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44b609-c1a4-4120-aee8-dcbf085ecd04 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:47.935048 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d05795-2adb-4d0c-8879-e2f54f02e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:47.936355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d05795-2adb-4d0c-8879-e2f54f02e79e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:47.937052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d05795-2adb-4d0c-8879-e2f54f02e79e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:47.937517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d05795-2adb-4d0c-8879-e2f54f02e79e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0a44b609-c1a4-4120-aee8-dcbf085ecd04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:47.937685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:47.938546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:47.940015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:47.940015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:47.940015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:47.940015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:47.940015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 278/562] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:47.940015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44b609-c1a4-4120-aee8-dcbf085ecd04 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:47.955057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d05795-2adb-4d0c-8879-e2f54f02e79e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a4d05795-2adb-4d0c-8879-e2f54f02e79e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:47.965637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:47.966568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:47.967443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:47.969561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 285/563] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:47.970398 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d05795-2adb-4d0c-8879-e2f54f02e79e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.055320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44b609-c1a4-4120-aee8-dcbf085ecd04 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.068265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:48.082478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d05795-2adb-4d0c-8879-e2f54f02e79e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.098785 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38c65e-99bb-4713-a8c1-f8952245b129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.100071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38c65e-99bb-4713-a8c1-f8952245b129 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.100569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38c65e-99bb-4713-a8c1-f8952245b129 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.101042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38c65e-99bb-4713-a8c1-f8952245b129 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.102057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38c65e-99bb-4713-a8c1-f8952245b129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:48.102581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38c65e-99bb-4713-a8c1-f8952245b129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.104503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38c65e-99bb-4713-a8c1-f8952245b129 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:48.119659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 279/564] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:48.120964 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38c65e-99bb-4713-a8c1-f8952245b129 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.125222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa5a2-41b2-465e-9c73-081fe8298986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.125965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa5a2-41b2-465e-9c73-081fe8298986 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.126251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa5a2-41b2-465e-9c73-081fe8298986 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.126525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa5a2-41b2-465e-9c73-081fe8298986 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.127792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fa5a2-41b2-465e-9c73-081fe8298986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:48.127792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fa5a2-41b2-465e-9c73-081fe8298986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.129201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fa5a2-41b2-465e-9c73-081fe8298986 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:48.143613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 286/565] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:48.144484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa5a2-41b2-465e-9c73-081fe8298986 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.180850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:48.233828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38c65e-99bb-4713-a8c1-f8952245b129 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.252094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa5a2-41b2-465e-9c73-081fe8298986 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.270781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb84a2-b609-423e-9bd9-8d47eac48dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.271786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb84a2-b609-423e-9bd9-8d47eac48dbf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.272283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb84a2-b609-423e-9bd9-8d47eac48dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.272799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb84a2-b609-423e-9bd9-8d47eac48dbf None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.273830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb84a2-b609-423e-9bd9-8d47eac48dbf None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:48.274326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb84a2-b609-423e-9bd9-8d47eac48dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.275896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb84a2-b609-423e-9bd9-8d47eac48dbf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:48.285720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 280/566] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:48.286921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb84a2-b609-423e-9bd9-8d47eac48dbf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.293177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1129-0adf-4ae3-8195-94b743309c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.293998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1129-0adf-4ae3-8195-94b743309c7a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.294275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1129-0adf-4ae3-8195-94b743309c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.294546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1129-0adf-4ae3-8195-94b743309c7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.302973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e1129-0adf-4ae3-8195-94b743309c7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.304494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e1129-0adf-4ae3-8195-94b743309c7a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:48.325903 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-af6e1129-0adf-4ae3-8195-94b743309c7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:48.327101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:48.328605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:48.329453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:48.329453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:48.329453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:48.329453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:48.329453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:48.329453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:48.329453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:48.329453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:48.330284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 287/567] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:48.330679 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1129-0adf-4ae3-8195-94b743309c7a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.402924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb84a2-b609-423e-9bd9-8d47eac48dbf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.434923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:48.441207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858eafa6-06fc-47c4-b59b-fd3819c1896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.441397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1129-0adf-4ae3-8195-94b743309c7a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eafa6-06fc-47c4-b59b-fd3819c1896d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.442657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eafa6-06fc-47c4-b59b-fd3819c1896d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.443022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eafa6-06fc-47c4-b59b-fd3819c1896d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.450174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858eafa6-06fc-47c4-b59b-fd3819c1896d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.451847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858eafa6-06fc-47c4-b59b-fd3819c1896d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-858eafa6-06fc-47c4-b59b-fd3819c1896d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:48.466042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:48.467232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:48.468309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:48.468309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:48.468309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:48.468309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:48.468309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:48.468309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:48.468309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:48.468309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:48.468309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 281/568] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:48.468309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858eafa6-06fc-47c4-b59b-fd3819c1896d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.478271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca4bac-ed40-4873-a6d1-2c06d17b6cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.479080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4bac-ed40-4873-a6d1-2c06d17b6cdb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.479359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4bac-ed40-4873-a6d1-2c06d17b6cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.479629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4bac-ed40-4873-a6d1-2c06d17b6cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.491081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca4bac-ed40-4873-a6d1-2c06d17b6cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.492614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca4bac-ed40-4873-a6d1-2c06d17b6cdb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2dca4bac-ed40-4873-a6d1-2c06d17b6cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:48.509372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:48.510348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:48.511239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:48.511239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:48.511239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:48.511239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:48.511239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 288/569] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:48.511824 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0683-360b-40d0-94e6-fce6da38f9c8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.512130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0683-360b-40d0-94e6-fce6da38f9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.512405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0683-360b-40d0-94e6-fce6da38f9c8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.514629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 289/570] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:48.514749 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf44c95-da21-498b-ae4d-48b815dffbd0 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.515151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf44c95-da21-498b-ae4d-48b815dffbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.515484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf44c95-da21-498b-ae4d-48b815dffbd0 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.516718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 290/571] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:48.517402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf44c95-da21-498b-ae4d-48b815dffbd0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.563687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:48.572467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858eafa6-06fc-47c4-b59b-fd3819c1896d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.609635 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf897e7-2f68-4c8b-9c9d-38667f263b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.610302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf897e7-2f68-4c8b-9c9d-38667f263b36 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.610581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf897e7-2f68-4c8b-9c9d-38667f263b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.610855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf897e7-2f68-4c8b-9c9d-38667f263b36 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.611800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf897e7-2f68-4c8b-9c9d-38667f263b36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:48.612170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf897e7-2f68-4c8b-9c9d-38667f263b36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.613707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf897e7-2f68-4c8b-9c9d-38667f263b36 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:48.620514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf44c95-da21-498b-ae4d-48b815dffbd0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.625680 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 282/572] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:48.626741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf897e7-2f68-4c8b-9c9d-38667f263b36 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.653708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0147fe-7079-4b43-9227-24c805085fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.654445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0147fe-7079-4b43-9227-24c805085fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.654905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0147fe-7079-4b43-9227-24c805085fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.655357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0147fe-7079-4b43-9227-24c805085fd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.656163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0147fe-7079-4b43-9227-24c805085fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:48.656468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0147fe-7079-4b43-9227-24c805085fd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.657925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0147fe-7079-4b43-9227-24c805085fd6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:48.670444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 291/573] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:48.671704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90efc3-4adc-492b-8596-0801bceca056 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.671991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90efc3-4adc-492b-8596-0801bceca056 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.672287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90efc3-4adc-492b-8596-0801bceca056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.688041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ef90efc3-4adc-492b-8596-0801bceca056 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:48.689230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ef90efc3-4adc-492b-8596-0801bceca056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:48.691192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:48.732619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf897e7-2f68-4c8b-9c9d-38667f263b36 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.757637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 292/574] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:48.758890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8344bd-2147-4fc9-8707-3101ed3900dd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.759196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8344bd-2147-4fc9-8707-3101ed3900dd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.759457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8344bd-2147-4fc9-8707-3101ed3900dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.766810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c931-dc4c-4397-a2e6-f4732580f59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.767538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c931-dc4c-4397-a2e6-f4732580f59c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.767823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c931-dc4c-4397-a2e6-f4732580f59c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.768128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c931-dc4c-4397-a2e6-f4732580f59c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.768861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c931-dc4c-4397-a2e6-f4732580f59c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:48.769172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c931-dc4c-4397-a2e6-f4732580f59c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.770560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c931-dc4c-4397-a2e6-f4732580f59c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:48.775660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3c8344bd-2147-4fc9-8707-3101ed3900dd None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:48.776856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3c8344bd-2147-4fc9-8707-3101ed3900dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:48.786923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 283/575] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:48.786923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c931-dc4c-4397-a2e6-f4732580f59c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.797789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:48.846609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 293/576] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:48.847445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8344bd-2147-4fc9-8707-3101ed3900dd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.892963 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c931-dc4c-4397-a2e6-f4732580f59c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.914984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:48.926953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6a0f-a8c8-4198-b99a-fe47f0a5d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.927878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6a0f-a8c8-4198-b99a-fe47f0a5d182 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.928200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6a0f-a8c8-4198-b99a-fe47f0a5d182 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.928485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6a0f-a8c8-4198-b99a-fe47f0a5d182 None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/311b3c1e00d64423865b35a188ede79a/roles/85ff050dde264c0fbb4e9e7efa4c1a34` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.943586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d6a0f-a8c8-4198-b99a-fe47f0a5d182 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=311b3c1e00d64423865b35a188ede79a, role_id=85ff050dde264c0fbb4e9e7efa4c1a34)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.945078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d6a0f-a8c8-4198-b99a-fe47f0a5d182 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:48.949122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8344bd-2147-4fc9-8707-3101ed3900dd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:48.958631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 284/577] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:15:48 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/311b3c1e00d64423865b35a188ede79a/roles/85ff050dde264c0fbb4e9e7efa4c1a34 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:48.959585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6a0f-a8c8-4198-b99a-fe47f0a5d182 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:48.988530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65fc0d-b04f-482f-b690-ffc4fb96e920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:48.989326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65fc0d-b04f-482f-b690-ffc4fb96e920 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:48.989613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65fc0d-b04f-482f-b690-ffc4fb96e920 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:48.989945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65fc0d-b04f-482f-b690-ffc4fb96e920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:48.990952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65fc0d-b04f-482f-b690-ffc4fb96e920 None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=7a79a7fbb30b45cd8677d84dd1b5c008) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:48.991269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65fc0d-b04f-482f-b690-ffc4fb96e920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:48.992917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65fc0d-b04f-482f-b690-ffc4fb96e920 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:49.012212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 294/578] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:48 2022] GET /identity/v3/role_assignments?user.id=7a79a7fbb30b45cd8677d84dd1b5c008&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:49.012212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65fc0d-b04f-482f-b690-ffc4fb96e920 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:49.049591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:49.113545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6a0f-a8c8-4198-b99a-fe47f0a5d182 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:49.147920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65fc0d-b04f-482f-b690-ffc4fb96e920 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:49.167159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb99b-e5b3-40ea-b846-1adeb8f6bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:49.168297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb99b-e5b3-40ea-b846-1adeb8f6bd8f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:49.168572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb99b-e5b3-40ea-b846-1adeb8f6bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:49.168848 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb99b-e5b3-40ea-b846-1adeb8f6bd8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:49.185438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bb99b-e5b3-40ea-b846-1adeb8f6bd8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:49.186937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-567bb99b-e5b3-40ea-b846-1adeb8f6bd8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:49.194506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:49.195487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:49.197244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 285/579] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:49.197919 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cb402-08f1-43a3-a17b-b05230401b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:49.198006 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb99b-e5b3-40ea-b846-1adeb8f6bd8f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:49.198074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb402-08f1-43a3-a17b-b05230401b5c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:49.198074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb402-08f1-43a3-a17b-b05230401b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:49.198074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb402-08f1-43a3-a17b-b05230401b5c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:49.209454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cb402-08f1-43a3-a17b-b05230401b5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:49.210984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cb402-08f1-43a3-a17b-b05230401b5c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-426cb402-08f1-43a3-a17b-b05230401b5c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:49.230714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:49.231718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:49.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 295/580] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:49.233957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cb402-08f1-43a3-a17b-b05230401b5c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:49.324514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb99b-e5b3-40ea-b846-1adeb8f6bd8f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:49.349139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:49.362102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59174c0-c1ee-4b5f-935c-e4b7858051ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:49.363253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59174c0-c1ee-4b5f-935c-e4b7858051ac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:49.363700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59174c0-c1ee-4b5f-935c-e4b7858051ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:49.364065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59174c0-c1ee-4b5f-935c-e4b7858051ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:49.366627 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cb402-08f1-43a3-a17b-b05230401b5c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:49.376205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59174c0-c1ee-4b5f-935c-e4b7858051ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e59174c0-c1ee-4b5f-935c-e4b7858051ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:49.384570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:49.386719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:49.388742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 286/581] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:49.396047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59174c0-c1ee-4b5f-935c-e4b7858051ac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:49.403109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945cd8e-f4eb-4b5f-a655-6f096b7923ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:49.403871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945cd8e-f4eb-4b5f-a655-6f096b7923ca None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:49.404279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945cd8e-f4eb-4b5f-a655-6f096b7923ca None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:49.404655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945cd8e-f4eb-4b5f-a655-6f096b7923ca None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:49.405561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945cd8e-f4eb-4b5f-a655-6f096b7923ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:49.405935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945cd8e-f4eb-4b5f-a655-6f096b7923ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:49.407419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945cd8e-f4eb-4b5f-a655-6f096b7923ca None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:49.422150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 296/582] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:49.423179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945cd8e-f4eb-4b5f-a655-6f096b7923ca None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:49.486567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:49.536826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945cd8e-f4eb-4b5f-a655-6f096b7923ca None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:49.540636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59174c0-c1ee-4b5f-935c-e4b7858051ac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:49.582858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d294f5-5a8a-4330-bc34-6844839a38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:49.583542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d294f5-5a8a-4330-bc34-6844839a38b3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:49.583826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d294f5-5a8a-4330-bc34-6844839a38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:49.584176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d294f5-5a8a-4330-bc34-6844839a38b3 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:49.585028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d294f5-5a8a-4330-bc34-6844839a38b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:49.585297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085db0f5-5fa8-4bbd-858a-7ad70f9ff649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:49.585436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d294f5-5a8a-4330-bc34-6844839a38b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:49.586236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085db0f5-5fa8-4bbd-858a-7ad70f9ff649 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:49.586664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085db0f5-5fa8-4bbd-858a-7ad70f9ff649 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:49.586786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d294f5-5a8a-4330-bc34-6844839a38b3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:49.587202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085db0f5-5fa8-4bbd-858a-7ad70f9ff649 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:49.588143 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085db0f5-5fa8-4bbd-858a-7ad70f9ff649 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:49.588849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085db0f5-5fa8-4bbd-858a-7ad70f9ff649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:49.591314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085db0f5-5fa8-4bbd-858a-7ad70f9ff649 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:49.607643 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 287/583] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 4 18:15:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:49.607643 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d294f5-5a8a-4330-bc34-6844839a38b3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:49.609145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 297/584] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:49.611192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085db0f5-5fa8-4bbd-858a-7ad70f9ff649 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:49.650869 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:49.713751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d294f5-5a8a-4330-bc34-6844839a38b3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:49.750825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bfabe-9359-4d32-ba55-64b19fa1fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:49.751101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085db0f5-5fa8-4bbd-858a-7ad70f9ff649 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:49.751632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bfabe-9359-4d32-ba55-64b19fa1fe88 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:49.751915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bfabe-9359-4d32-ba55-64b19fa1fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:49.752218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bfabe-9359-4d32-ba55-64b19fa1fe88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:49.763239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bfabe-9359-4d32-ba55-64b19fa1fe88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:49.764865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bfabe-9359-4d32-ba55-64b19fa1fe88 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:49.772947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-277bfabe-9359-4d32-ba55-64b19fa1fe88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:49.784984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:49.786161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:49.787221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:49.787221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:49.787221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:49.787221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:49.791060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 288/585] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:49.791861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bfabe-9359-4d32-ba55-64b19fa1fe88 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:49.798188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da8b3c-ba97-4f58-9903-f68a93f67804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:49.799222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da8b3c-ba97-4f58-9903-f68a93f67804 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:49.799665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da8b3c-ba97-4f58-9903-f68a93f67804 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:49.800114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da8b3c-ba97-4f58-9903-f68a93f67804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:49.813826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da8b3c-ba97-4f58-9903-f68a93f67804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:49.815452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da8b3c-ba97-4f58-9903-f68a93f67804 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e2da8b3c-ba97-4f58-9903-f68a93f67804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:49.838203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:49.839367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:49.840474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:49.840474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:49.840474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:49.840474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:49.844800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 298/586] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:49.845720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da8b3c-ba97-4f58-9903-f68a93f67804 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:49.910871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:49.924255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bfabe-9359-4d32-ba55-64b19fa1fe88 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:49.966565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28c5db-acf2-4f9b-b1b8-64b10460a3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:49.967555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da8b3c-ba97-4f58-9903-f68a93f67804 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:49.968774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28c5db-acf2-4f9b-b1b8-64b10460a3db None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:49.969338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28c5db-acf2-4f9b-b1b8-64b10460a3db None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:49.970593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28c5db-acf2-4f9b-b1b8-64b10460a3db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:49.984343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28c5db-acf2-4f9b-b1b8-64b10460a3db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:49.986273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28c5db-acf2-4f9b-b1b8-64b10460a3db None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.005364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc5fed-a8d8-40a7-982f-642c742bb378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.006136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5fed-a8d8-40a7-982f-642c742bb378 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.006489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5fed-a8d8-40a7-982f-642c742bb378 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.006838 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc5fed-a8d8-40a7-982f-642c742bb378 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.007639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc5fed-a8d8-40a7-982f-642c742bb378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:50.008015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc5fed-a8d8-40a7-982f-642c742bb378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ba28c5db-acf2-4f9b-b1b8-64b10460a3db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:50.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:50.009179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:50.010262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:50.010262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:50.010262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:50.010262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:50.011102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc5fed-a8d8-40a7-982f-642c742bb378 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.011959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 289/587] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:50.013168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28c5db-acf2-4f9b-b1b8-64b10460a3db None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.026199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 299/588] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:50.028478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc5fed-a8d8-40a7-982f-642c742bb378 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.064667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:50.152996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28c5db-acf2-4f9b-b1b8-64b10460a3db None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:50.156612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc5fed-a8d8-40a7-982f-642c742bb378 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:50.203279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541dd86-74ee-4ec6-bf9e-c6e3cf8800f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.204382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f732c8-b761-4fc5-8e1a-56f2e4e75ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.204742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541dd86-74ee-4ec6-bf9e-c6e3cf8800f9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.205056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f732c8-b761-4fc5-8e1a-56f2e4e75ffc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.205400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f732c8-b761-4fc5-8e1a-56f2e4e75ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.205727 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541dd86-74ee-4ec6-bf9e-c6e3cf8800f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.205837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f732c8-b761-4fc5-8e1a-56f2e4e75ffc None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.206301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541dd86-74ee-4ec6-bf9e-c6e3cf8800f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.206536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f732c8-b761-4fc5-8e1a-56f2e4e75ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:50.206848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f732c8-b761-4fc5-8e1a-56f2e4e75ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.207659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541dd86-74ee-4ec6-bf9e-c6e3cf8800f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:50.208244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541dd86-74ee-4ec6-bf9e-c6e3cf8800f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.208358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f732c8-b761-4fc5-8e1a-56f2e4e75ffc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.210320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541dd86-74ee-4ec6-bf9e-c6e3cf8800f9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.221035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 300/589] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:50.221816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f732c8-b761-4fc5-8e1a-56f2e4e75ffc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.228081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 290/590] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:50.229261 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541dd86-74ee-4ec6-bf9e-c6e3cf8800f9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.233757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:50.330919 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:50.343501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f732c8-b761-4fc5-8e1a-56f2e4e75ffc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:50.368865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541dd86-74ee-4ec6-bf9e-c6e3cf8800f9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:50.388349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e29e0c-5c4e-4fff-b387-4158592fca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.389934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29e0c-5c4e-4fff-b387-4158592fca3e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.390446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29e0c-5c4e-4fff-b387-4158592fca3e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.391153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e29e0c-5c4e-4fff-b387-4158592fca3e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.402383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e29e0c-5c4e-4fff-b387-4158592fca3e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.405365 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e29e0c-5c4e-4fff-b387-4158592fca3e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.408342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf57f1-9afa-4dff-af91-7e09c0dfd00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.409132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf57f1-9afa-4dff-af91-7e09c0dfd00a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.409406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf57f1-9afa-4dff-af91-7e09c0dfd00a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.409674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf57f1-9afa-4dff-af91-7e09c0dfd00a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.416536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf57f1-9afa-4dff-af91-7e09c0dfd00a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.418317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf57f1-9afa-4dff-af91-7e09c0dfd00a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-65e29e0c-5c4e-4fff-b387-4158592fca3e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:50.424108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:50.425154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:50.426098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:50.426098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:50.426098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:50.426098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:50.426098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:50.426098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:50.426098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:50.426098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:50.426098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 18:15:50.426098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:50.428238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 301/591] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:50.429149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e29e0c-5c4e-4fff-b387-4158592fca3e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e8cf57f1-9afa-4dff-af91-7e09c0dfd00a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:50.435711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:50.436827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:50.437974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:50.437974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:50.437974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:50.437974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:50.437974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:50.437974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:50.437974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:50.437974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:50.443972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 291/592] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:50.444928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf57f1-9afa-4dff-af91-7e09c0dfd00a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.512835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:50.553922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf57f1-9afa-4dff-af91-7e09c0dfd00a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:50.554865 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e29e0c-5c4e-4fff-b387-4158592fca3e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:50.589233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e060-f04f-4f2c-8efc-602ef92d1717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.590092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e060-f04f-4f2c-8efc-602ef92d1717 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.590472 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e060-f04f-4f2c-8efc-602ef92d1717 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.590840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e060-f04f-4f2c-8efc-602ef92d1717 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.591136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd455b-a6f7-4521-93b4-8180589552ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.591914 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e060-f04f-4f2c-8efc-602ef92d1717 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:50.592324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd455b-a6f7-4521-93b4-8180589552ca None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.592447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e060-f04f-4f2c-8efc-602ef92d1717 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.592872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd455b-a6f7-4521-93b4-8180589552ca None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.593286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd455b-a6f7-4521-93b4-8180589552ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.594132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e060-f04f-4f2c-8efc-602ef92d1717 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.601896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd455b-a6f7-4521-93b4-8180589552ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.603590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd455b-a6f7-4521-93b4-8180589552ca None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.613688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 292/593] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Jun 4 18:15:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:50.614854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e060-f04f-4f2c-8efc-602ef92d1717 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5bbd455b-a6f7-4521-93b4-8180589552ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:50.619139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:50.620158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:50.621056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:50.621056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:50.621056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:50.621056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:50.621056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:50.621056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:50.621056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:50.621056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:50.621056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 18:15:50.621056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:50.623650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 302/594] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:50.624660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd455b-a6f7-4521-93b4-8180589552ca None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.636223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:50.725809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e060-f04f-4f2c-8efc-602ef92d1717 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:50.731595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd455b-a6f7-4521-93b4-8180589552ca None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:50.751226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:50.765320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ab875-0dea-4ca3-af77-0ea482b3b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.765920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ab875-0dea-4ca3-af77-0ea482b3b49c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.766200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ab875-0dea-4ca3-af77-0ea482b3b49c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.766472 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ab875-0dea-4ca3-af77-0ea482b3b49c None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.767287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ab875-0dea-4ca3-af77-0ea482b3b49c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:50.767565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ab875-0dea-4ca3-af77-0ea482b3b49c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.769238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ab875-0dea-4ca3-af77-0ea482b3b49c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.769907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f212b-cc71-4eec-bc65-25dba751512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.770949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f212b-cc71-4eec-bc65-25dba751512d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.771431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f212b-cc71-4eec-bc65-25dba751512d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.771911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f212b-cc71-4eec-bc65-25dba751512d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.785647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f212b-cc71-4eec-bc65-25dba751512d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.787194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 293/595] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:50.787675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f212b-cc71-4eec-bc65-25dba751512d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.788218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ab875-0dea-4ca3-af77-0ea482b3b49c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1c1f212b-cc71-4eec-bc65-25dba751512d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:50.806946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:50.807882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:50.808779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:50.808779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:50.808779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:50.808779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:50.811207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 303/596] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:50.820769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f212b-cc71-4eec-bc65-25dba751512d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.890696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:50.897299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ab875-0dea-4ca3-af77-0ea482b3b49c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:50.937240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ce93-a475-4458-9ac5-f2f159cfc84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.938201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ce93-a475-4458-9ac5-f2f159cfc84a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.938631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ce93-a475-4458-9ac5-f2f159cfc84a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.938744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f212b-cc71-4eec-bc65-25dba751512d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:50.939177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ce93-a475-4458-9ac5-f2f159cfc84a None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.940224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5ce93-a475-4458-9ac5-f2f159cfc84a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:50.940801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5ce93-a475-4458-9ac5-f2f159cfc84a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.942529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5ce93-a475-4458-9ac5-f2f159cfc84a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:50.968100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 294/597] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 4 18:15:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:50.969281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ce93-a475-4458-9ac5-f2f159cfc84a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:50.976195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18649f-2a8d-4064-a794-9149464e41e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:50.977179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18649f-2a8d-4064-a794-9149464e41e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:50.977534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18649f-2a8d-4064-a794-9149464e41e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:50.977876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18649f-2a8d-4064-a794-9149464e41e9 None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/3b4adc107bf542b8bb0502c7fbf94431/roles/85ff050dde264c0fbb4e9e7efa4c1a34` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:50.993950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18649f-2a8d-4064-a794-9149464e41e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=3b4adc107bf542b8bb0502c7fbf94431, role_id=85ff050dde264c0fbb4e9e7efa4c1a34)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:50.995520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18649f-2a8d-4064-a794-9149464e41e9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:51.013325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 304/598] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:15:50 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/3b4adc107bf542b8bb0502c7fbf94431/roles/85ff050dde264c0fbb4e9e7efa4c1a34 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:51.014560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18649f-2a8d-4064-a794-9149464e41e9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:51.019583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:51.107039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ce93-a475-4458-9ac5-f2f159cfc84a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:51.185036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728638f9-f4c1-4fd0-a9b8-39db8e7a48d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:51.186920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728638f9-f4c1-4fd0-a9b8-39db8e7a48d4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.187396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728638f9-f4c1-4fd0-a9b8-39db8e7a48d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.187856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728638f9-f4c1-4fd0-a9b8-39db8e7a48d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.188822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728638f9-f4c1-4fd0-a9b8-39db8e7a48d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:51.189313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728638f9-f4c1-4fd0-a9b8-39db8e7a48d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:51.190910 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728638f9-f4c1-4fd0-a9b8-39db8e7a48d4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:51.194305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18649f-2a8d-4064-a794-9149464e41e9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:51.220414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 295/599] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:51.224408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:51.229178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728638f9-f4c1-4fd0-a9b8-39db8e7a48d4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:51.285345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d24ea-de9e-4cac-9cac-8034c7a0feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:51.287019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d24ea-de9e-4cac-9cac-8034c7a0feed None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.287314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d24ea-de9e-4cac-9cac-8034c7a0feed None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.287593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d24ea-de9e-4cac-9cac-8034c7a0feed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.301647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d24ea-de9e-4cac-9cac-8034c7a0feed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:51.303232 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d24ea-de9e-4cac-9cac-8034c7a0feed None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-620d24ea-de9e-4cac-9cac-8034c7a0feed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:51.326465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:51.327610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:51.328741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:51.328741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:51.328741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:51.328741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:51.328741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 305/600] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:51.329478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cb456-ec4d-4a6a-88fc-a71428efcc0b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.329764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cb456-ec4d-4a6a-88fc-a71428efcc0b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.330035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cb456-ec4d-4a6a-88fc-a71428efcc0b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.331278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 306/601] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:51.335999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cb456-ec4d-4a6a-88fc-a71428efcc0b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:51.377176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:51.379537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728638f9-f4c1-4fd0-a9b8-39db8e7a48d4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:51.416639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaa908-e77e-423a-a64d-6cd0e1806195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:51.416904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaa908-e77e-423a-a64d-6cd0e1806195 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.417149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaa908-e77e-423a-a64d-6cd0e1806195 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.417684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaa908-e77e-423a-a64d-6cd0e1806195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.428945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaa908-e77e-423a-a64d-6cd0e1806195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:51.428945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaa908-e77e-423a-a64d-6cd0e1806195 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ffeaa908-e77e-423a-a64d-6cd0e1806195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:51.441367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:51.442277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:51.443502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:51.443502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:51.443502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:51.443502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:51.443502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:51.443502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:51.443502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:51.443502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:51.443502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 296/602] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:51.445216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c9670-43ed-4daa-bf6b-ec773ccf5f02 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.445588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c9670-43ed-4daa-bf6b-ec773ccf5f02 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.445949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c9670-43ed-4daa-bf6b-ec773ccf5f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.458444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cb456-ec4d-4a6a-88fc-a71428efcc0b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:51.464891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-182c9670-43ed-4daa-bf6b-ec773ccf5f02 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:51.466102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-182c9670-43ed-4daa-bf6b-ec773ccf5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:51.493547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0b3a8-70cc-4764-994e-94284a68b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:51.494262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0b3a8-70cc-4764-994e-94284a68b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.494498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0b3a8-70cc-4764-994e-94284a68b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.494771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0b3a8-70cc-4764-994e-94284a68b5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.495511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0b3a8-70cc-4764-994e-94284a68b5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:51.495815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0b3a8-70cc-4764-994e-94284a68b5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:51.497265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0b3a8-70cc-4764-994e-94284a68b5d3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:51.509686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 307/603] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:51.514809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0b3a8-70cc-4764-994e-94284a68b5d3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:51.540460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 297/604] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:51.540460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc71b2-cc08-41f6-ad85-8763f3ca2e6e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.540460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc71b2-cc08-41f6-ad85-8763f3ca2e6e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.540460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc71b2-cc08-41f6-ad85-8763f3ca2e6e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.540460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 298/605] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:51.540460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc71b2-cc08-41f6-ad85-8763f3ca2e6e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:51.548519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:51.628480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0b3a8-70cc-4764-994e-94284a68b5d3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:51.655094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:51.666151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b745911-eaac-4bf0-bb31-b5d825430ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:51.666463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc71b2-cc08-41f6-ad85-8763f3ca2e6e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:51.666829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745911-eaac-4bf0-bb31-b5d825430ada None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.667113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745911-eaac-4bf0-bb31-b5d825430ada None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.667745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745911-eaac-4bf0-bb31-b5d825430ada None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.668745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745911-eaac-4bf0-bb31-b5d825430ada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:51.669896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745911-eaac-4bf0-bb31-b5d825430ada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:51.671504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745911-eaac-4bf0-bb31-b5d825430ada None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:51.683881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 308/606] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:51.685540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf76b-1ef9-4bf2-ad7b-23e46c13e2e0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.685864 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf76b-1ef9-4bf2-ad7b-23e46c13e2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.686142 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcf76b-1ef9-4bf2-ad7b-23e46c13e2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.704516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1bfcf76b-1ef9-4bf2-ad7b-23e46c13e2e0 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:51.705756 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1bfcf76b-1ef9-4bf2-ad7b-23e46c13e2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:51.707101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7e392-9e81-4eec-a4a3-91a46313f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:51.707906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7e392-9e81-4eec-a4a3-91a46313f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.708216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7e392-9e81-4eec-a4a3-91a46313f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.708584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7e392-9e81-4eec-a4a3-91a46313f1a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.715350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7e392-9e81-4eec-a4a3-91a46313f1a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:51.717189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7e392-9e81-4eec-a4a3-91a46313f1a3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-04e7e392-9e81-4eec-a4a3-91a46313f1a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:51.730930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:51.731896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:51.732899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:51.732899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:51.732899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:51.732899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:51.732899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:51.732899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:51.732899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:51.732899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:51.736843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 299/607] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:51.737693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7e392-9e81-4eec-a4a3-91a46313f1a3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:51.780372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 309/608] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:51.788363 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcf76b-1ef9-4bf2-ad7b-23e46c13e2e0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:51.803151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:51.847769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7e392-9e81-4eec-a4a3-91a46313f1a3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:51.884361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5adef-93de-4a01-87cb-d6fe46b96dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:51.885311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5adef-93de-4a01-87cb-d6fe46b96dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.885708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5adef-93de-4a01-87cb-d6fe46b96dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.886081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5adef-93de-4a01-87cb-d6fe46b96dc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.897412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5adef-93de-4a01-87cb-d6fe46b96dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:51.899640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcf76b-1ef9-4bf2-ad7b-23e46c13e2e0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a0d5adef-93de-4a01-87cb-d6fe46b96dc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:51.905109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:51.906025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 300/609] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:51.912669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5adef-93de-4a01-87cb-d6fe46b96dc0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:51.921658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:51.944640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840ab70-3856-4fcd-8cd8-a4ac05486415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:51.945685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840ab70-3856-4fcd-8cd8-a4ac05486415 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:51.945967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840ab70-3856-4fcd-8cd8-a4ac05486415 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:51.946352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840ab70-3856-4fcd-8cd8-a4ac05486415 None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/37c4400204794a54957ccf28df938f46/roles/85ff050dde264c0fbb4e9e7efa4c1a34` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:51.962276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840ab70-3856-4fcd-8cd8-a4ac05486415 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=37c4400204794a54957ccf28df938f46, role_id=85ff050dde264c0fbb4e9e7efa4c1a34)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:51.963863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840ab70-3856-4fcd-8cd8-a4ac05486415 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:51.979730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 310/610] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:15:51 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/37c4400204794a54957ccf28df938f46/roles/85ff050dde264c0fbb4e9e7efa4c1a34 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:51.980654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840ab70-3856-4fcd-8cd8-a4ac05486415 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:52.028667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5adef-93de-4a01-87cb-d6fe46b96dc0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:52.060326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:52.068858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dc6a7-cc3f-4e3f-81cb-99689ed6e68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:52.069840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dc6a7-cc3f-4e3f-81cb-99689ed6e68b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:52.070272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dc6a7-cc3f-4e3f-81cb-99689ed6e68b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:52.070740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2dc6a7-cc3f-4e3f-81cb-99689ed6e68b None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:52.071526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dc6a7-cc3f-4e3f-81cb-99689ed6e68b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:52.071843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dc6a7-cc3f-4e3f-81cb-99689ed6e68b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:52.073500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2dc6a7-cc3f-4e3f-81cb-99689ed6e68b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:52.092764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 301/611] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:52.093749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dc6a7-cc3f-4e3f-81cb-99689ed6e68b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:52.111115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840ab70-3856-4fcd-8cd8-a4ac05486415 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:52.152870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72684e-9cfe-4ca2-91ab-535b76e40887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:52.154642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72684e-9cfe-4ca2-91ab-535b76e40887 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:52.155167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72684e-9cfe-4ca2-91ab-535b76e40887 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:52.156115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72684e-9cfe-4ca2-91ab-535b76e40887 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:52.173336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72684e-9cfe-4ca2-91ab-535b76e40887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:52.184993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-fe72684e-9cfe-4ca2-91ab-535b76e40887 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:52.185588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:52.186746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:52.188873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:52.192293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 311/612] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:52.193395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72684e-9cfe-4ca2-91ab-535b76e40887 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:52.233380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2dc6a7-cc3f-4e3f-81cb-99689ed6e68b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:52.276086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4fe3d-4a84-4283-bf25-82ebe7a34013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:52.276781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4fe3d-4a84-4283-bf25-82ebe7a34013 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:52.277067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4fe3d-4a84-4283-bf25-82ebe7a34013 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:52.277811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4fe3d-4a84-4283-bf25-82ebe7a34013 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:52.278601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4fe3d-4a84-4283-bf25-82ebe7a34013 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:52.278914 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4fe3d-4a84-4283-bf25-82ebe7a34013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:52.281064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4fe3d-4a84-4283-bf25-82ebe7a34013 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:52.293657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 302/613] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:52.295916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4fe3d-4a84-4283-bf25-82ebe7a34013 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:52.321342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72684e-9cfe-4ca2-91ab-535b76e40887 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:52.348369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:52.358410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be79b9-8713-4d48-b54d-462df3258570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:52.359429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be79b9-8713-4d48-b54d-462df3258570 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:52.359714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be79b9-8713-4d48-b54d-462df3258570 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:52.359995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be79b9-8713-4d48-b54d-462df3258570 None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/43023787db0749e8be546755f521755b/roles/85ff050dde264c0fbb4e9e7efa4c1a34` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:52.377974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be79b9-8713-4d48-b54d-462df3258570 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=43023787db0749e8be546755f521755b, role_id=85ff050dde264c0fbb4e9e7efa4c1a34)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:52.379479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be79b9-8713-4d48-b54d-462df3258570 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:52.397316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 312/614] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:15:52 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/43023787db0749e8be546755f521755b/roles/85ff050dde264c0fbb4e9e7efa4c1a34 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:52.398240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be79b9-8713-4d48-b54d-462df3258570 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:52.434722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4fe3d-4a84-4283-bf25-82ebe7a34013 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:52.488247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:52.499250 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b00f1-13cf-46d0-a72f-2ad01f0c9d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:52.500246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b00f1-13cf-46d0-a72f-2ad01f0c9d92 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:52.500681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b00f1-13cf-46d0-a72f-2ad01f0c9d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:52.501664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b00f1-13cf-46d0-a72f-2ad01f0c9d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:52.505859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b00f1-13cf-46d0-a72f-2ad01f0c9d92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:52.506179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b00f1-13cf-46d0-a72f-2ad01f0c9d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:52.507664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b00f1-13cf-46d0-a72f-2ad01f0c9d92 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:52.527192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 303/615] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:52.532164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be79b9-8713-4d48-b54d-462df3258570 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:52.532855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b00f1-13cf-46d0-a72f-2ad01f0c9d92 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:52.574159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd6b6-e0d7-4572-9a9f-5a8a1cef19cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:52.575352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd6b6-e0d7-4572-9a9f-5a8a1cef19cd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:52.575856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd6b6-e0d7-4572-9a9f-5a8a1cef19cd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:52.576800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd6b6-e0d7-4572-9a9f-5a8a1cef19cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:52.590146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dd6b6-e0d7-4572-9a9f-5a8a1cef19cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:52.592066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dd6b6-e0d7-4572-9a9f-5a8a1cef19cd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5a4dd6b6-e0d7-4572-9a9f-5a8a1cef19cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:52.615450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:52.616444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:52.617325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:52.617325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:52.617325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:52.617325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:52.617563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 313/616] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:52.625104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd6b6-e0d7-4572-9a9f-5a8a1cef19cd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:52.655464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:52.720630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b00f1-13cf-46d0-a72f-2ad01f0c9d92 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:52.750997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd6b6-e0d7-4572-9a9f-5a8a1cef19cd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:52.772536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7936bc-7563-49a3-a483-53886d84e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:52.773820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7936bc-7563-49a3-a483-53886d84e250 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:52.774101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7936bc-7563-49a3-a483-53886d84e250 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:52.774375 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7936bc-7563-49a3-a483-53886d84e250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:52.795895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7936bc-7563-49a3-a483-53886d84e250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:52.798444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7936bc-7563-49a3-a483-53886d84e250 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:52.814890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69192-acac-40c0-aabd-d4dde5943b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:52.815910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69192-acac-40c0-aabd-d4dde5943b69 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:52.817883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69192-acac-40c0-aabd-d4dde5943b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:52.818443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69192-acac-40c0-aabd-d4dde5943b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:52.819386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db69192-acac-40c0-aabd-d4dde5943b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:52.820911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db69192-acac-40c0-aabd-d4dde5943b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:52.822526 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db69192-acac-40c0-aabd-d4dde5943b69 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-eb7936bc-7563-49a3-a483-53886d84e250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:52.830999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:52.831865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:52.832767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:52.832767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:52.832767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:52.832767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:52.841200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 304/617] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:52.847316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7936bc-7563-49a3-a483-53886d84e250 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:52.854663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 314/618] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:52.855583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69192-acac-40c0-aabd-d4dde5943b69 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:52.904704 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:52.992540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7936bc-7563-49a3-a483-53886d84e250 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:53.011045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:53.029556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68815541-0bc8-4b60-aeef-70536eb65cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:53.030608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68815541-0bc8-4b60-aeef-70536eb65cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:53.031090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68815541-0bc8-4b60-aeef-70536eb65cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:53.031424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69192-acac-40c0-aabd-d4dde5943b69 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:53.031889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68815541-0bc8-4b60-aeef-70536eb65cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:53.032857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68815541-0bc8-4b60-aeef-70536eb65cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:53.033359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68815541-0bc8-4b60-aeef-70536eb65cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:53.034989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68815541-0bc8-4b60-aeef-70536eb65cf3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:53.049827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 305/619] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:53.055459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68815541-0bc8-4b60-aeef-70536eb65cf3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:53.068541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333df277-c6ae-45e6-b32b-3cad8e0af41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:53.069503 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df277-c6ae-45e6-b32b-3cad8e0af41f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:53.069787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df277-c6ae-45e6-b32b-3cad8e0af41f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:53.070065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df277-c6ae-45e6-b32b-3cad8e0af41f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:53.079677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333df277-c6ae-45e6-b32b-3cad8e0af41f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:53.081402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333df277-c6ae-45e6-b32b-3cad8e0af41f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-333df277-c6ae-45e6-b32b-3cad8e0af41f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:53.097154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:53.098187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:53.099104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:53.099104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:53.099104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:53.099104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:53.099104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:53.099104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:53.099104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:53.099104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:53.099104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:15:53.099104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:53.103356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 315/620] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 4 18:15:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:53.105446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333df277-c6ae-45e6-b32b-3cad8e0af41f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:53.170927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68815541-0bc8-4b60-aeef-70536eb65cf3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:53.184400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:53.228030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333df277-c6ae-45e6-b32b-3cad8e0af41f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:53.229762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd821fc3-ee4c-4e4a-9962-4b19c1a3198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:53.230820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821fc3-ee4c-4e4a-9962-4b19c1a3198f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:53.231307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821fc3-ee4c-4e4a-9962-4b19c1a3198f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:53.231777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821fc3-ee4c-4e4a-9962-4b19c1a3198f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:53.239703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd821fc3-ee4c-4e4a-9962-4b19c1a3198f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:53.241927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd821fc3-ee4c-4e4a-9962-4b19c1a3198f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-fd821fc3-ee4c-4e4a-9962-4b19c1a3198f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:53.256834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:53.257788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:53.258731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:53.258731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:53.258731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:53.258731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:53.258731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:53.258731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:53.258731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:53.258731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:53.258731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:15:53.258731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:53.261317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 306/621] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:15:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:53.267800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd821fc3-ee4c-4e4a-9962-4b19c1a3198f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:53.282243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ec042-5d9c-4d83-9758-6d014fb7164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:53.282938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ec042-5d9c-4d83-9758-6d014fb7164f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:53.283206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ec042-5d9c-4d83-9758-6d014fb7164f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:53.283496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ec042-5d9c-4d83-9758-6d014fb7164f None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:53.284359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ec042-5d9c-4d83-9758-6d014fb7164f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:53.284666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ec042-5d9c-4d83-9758-6d014fb7164f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:53.286293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ec042-5d9c-4d83-9758-6d014fb7164f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:53.315955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 316/622] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 4 18:15:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:53.317376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ec042-5d9c-4d83-9758-6d014fb7164f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:53.319986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:53.424740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ec042-5d9c-4d83-9758-6d014fb7164f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:53.456770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd821fc3-ee4c-4e4a-9962-4b19c1a3198f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:53.472708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e7751-aa51-4681-9bd8-3b14ec984e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:53.473975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7751-aa51-4681-9bd8-3b14ec984e8c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:53.474475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7751-aa51-4681-9bd8-3b14ec984e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:53.475006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7751-aa51-4681-9bd8-3b14ec984e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:53.500038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8f796-8fc1-43c5-af7b-e773f7ec427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:53.500038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8f796-8fc1-43c5-af7b-e773f7ec427f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:53.500038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8f796-8fc1-43c5-af7b-e773f7ec427f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:53.500414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8f796-8fc1-43c5-af7b-e773f7ec427f None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:53.501281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8f796-8fc1-43c5-af7b-e773f7ec427f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:53.501655 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8f796-8fc1-43c5-af7b-e773f7ec427f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:53.503209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8f796-8fc1-43c5-af7b-e773f7ec427f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:53.528905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 307/623] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 4 18:15:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:53.530640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0e4e-dc3f-403a-bee9-a56e6d175528 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:53.531166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0e4e-dc3f-403a-bee9-a56e6d175528 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:53.531659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0e4e-dc3f-403a-bee9-a56e6d175528 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:53.533719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 308/624] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:53.534569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad0e4e-dc3f-403a-bee9-a56e6d175528 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:53.564752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e7751-aa51-4681-9bd8-3b14ec984e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:53.566567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e7751-aa51-4681-9bd8-3b14ec984e8c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:53.569107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:53.572370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:53.717023 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad0e4e-dc3f-403a-bee9-a56e6d175528 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:53.752878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 317/625] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:53.754596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f6c6b-4cf4-4706-8c82-750c1746a0c3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:53.756538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f6c6b-4cf4-4706-8c82-750c1746a0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:53.757000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f6c6b-4cf4-4706-8c82-750c1746a0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:53.784966 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-758f6c6b-4cf4-4706-8c82-750c1746a0c3 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:53.786437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578687a-ee48-4ae5-be7a-ab886b23599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:53.787474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578687a-ee48-4ae5-be7a-ab886b23599a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:53.787956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578687a-ee48-4ae5-be7a-ab886b23599a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:53.788423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578687a-ee48-4ae5-be7a-ab886b23599a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:53.790312 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-758f6c6b-4cf4-4706-8c82-750c1746a0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:53.810536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578687a-ee48-4ae5-be7a-ab886b23599a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:53.812449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578687a-ee48-4ae5-be7a-ab886b23599a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b578687a-ee48-4ae5-be7a-ab886b23599a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:53.842558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:53.843697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:53.844936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:53.844936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:53.844936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:53.844936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:53.853963 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 309/626] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:53.856802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578687a-ee48-4ae5-be7a-ab886b23599a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:53.912233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 318/627] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:53.913152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f6c6b-4cf4-4706-8c82-750c1746a0c3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:53.982405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:54.039517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:54.082320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578687a-ee48-4ae5-be7a-ab886b23599a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:54.111741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f6c6b-4cf4-4706-8c82-750c1746a0c3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:54.119410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280a394-7062-4fab-aa3b-0222f7eaad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:54.120345 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280a394-7062-4fab-aa3b-0222f7eaad78 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.120692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280a394-7062-4fab-aa3b-0222f7eaad78 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.121108 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280a394-7062-4fab-aa3b-0222f7eaad78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.134645 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280a394-7062-4fab-aa3b-0222f7eaad78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:54.136731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280a394-7062-4fab-aa3b-0222f7eaad78 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:54.153387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec0761-e6ab-459e-8ff8-a60e96ae1fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:54.154057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec0761-e6ab-459e-8ff8-a60e96ae1fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.154504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec0761-e6ab-459e-8ff8-a60e96ae1fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.154917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec0761-e6ab-459e-8ff8-a60e96ae1fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.155591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec0761-e6ab-459e-8ff8-a60e96ae1fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:54.155894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec0761-e6ab-459e-8ff8-a60e96ae1fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:54.157321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec0761-e6ab-459e-8ff8-a60e96ae1fe4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1280a394-7062-4fab-aa3b-0222f7eaad78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:54.158477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:54.159412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:54.160298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:54.160298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:54.160298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:54.160298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:54.161288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 310/628] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:54.162130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280a394-7062-4fab-aa3b-0222f7eaad78 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:54.172362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 319/629] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:54.173876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec0761-e6ab-459e-8ff8-a60e96ae1fe4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:54.287227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:54.289110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280a394-7062-4fab-aa3b-0222f7eaad78 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:54.299157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec0761-e6ab-459e-8ff8-a60e96ae1fe4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:54.325700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:54.334596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc8ada-4f4f-4de5-8c21-082c0bac6efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:54.335711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8ada-4f4f-4de5-8c21-082c0bac6efb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.336231 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8ada-4f4f-4de5-8c21-082c0bac6efb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.336699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8ada-4f4f-4de5-8c21-082c0bac6efb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.338663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83fb5c-8815-41b6-a8e8-35522ce134de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:54.339323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83fb5c-8815-41b6-a8e8-35522ce134de None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.339599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83fb5c-8815-41b6-a8e8-35522ce134de None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.339872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83fb5c-8815-41b6-a8e8-35522ce134de None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.340740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83fb5c-8815-41b6-a8e8-35522ce134de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:54.341045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83fb5c-8815-41b6-a8e8-35522ce134de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:54.342689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83fb5c-8815-41b6-a8e8-35522ce134de None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:54.349557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc8ada-4f4f-4de5-8c21-082c0bac6efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:54.357735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 320/630] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:54.357735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83fb5c-8815-41b6-a8e8-35522ce134de None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-55bc8ada-4f4f-4de5-8c21-082c0bac6efb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:54.364878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:54.365891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:54.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:54.369611 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 311/631] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:54.370757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc8ada-4f4f-4de5-8c21-082c0bac6efb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:54.472587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83fb5c-8815-41b6-a8e8-35522ce134de None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:54.475530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc8ada-4f4f-4de5-8c21-082c0bac6efb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:54.509149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7700c-9474-4551-992e-6eda770a9fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:54.510046 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7700c-9474-4551-992e-6eda770a9fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.510326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7700c-9474-4551-992e-6eda770a9fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.510598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7700c-9474-4551-992e-6eda770a9fb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.510888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a54eb-0846-4642-830b-77b876fb7e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:54.511930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a54eb-0846-4642-830b-77b876fb7e45 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.512443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a54eb-0846-4642-830b-77b876fb7e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.512917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a54eb-0846-4642-830b-77b876fb7e45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.518407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7700c-9474-4551-992e-6eda770a9fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:54.519959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7700c-9474-4551-992e-6eda770a9fb2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:54.521406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a54eb-0846-4642-830b-77b876fb7e45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:54.523057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a54eb-0846-4642-830b-77b876fb7e45 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3fa7700c-9474-4551-992e-6eda770a9fb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:54.534478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:54.535387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:54.536266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:54.536266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:54.536266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:54.536266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:54.536266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:54.536266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:54.536266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:54.536266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:54.536266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 321/632] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:54.537189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7700c-9474-4551-992e-6eda770a9fb2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-061a54eb-0846-4642-830b-77b876fb7e45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:54.540934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:54.541793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:54.543010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:54.543010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:54.543010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:54.543010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:54.543010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:54.543010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:54.543010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:54.543010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:54.545473 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 312/633] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:54.546539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a54eb-0846-4642-830b-77b876fb7e45 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:54.553302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:54.597889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:54.645172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7700c-9474-4551-992e-6eda770a9fb2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:54.651153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a54eb-0846-4642-830b-77b876fb7e45 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:54.681385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0af1a1-a952-4d1d-8a40-82c465a5bcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:54.682052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af1a1-a952-4d1d-8a40-82c465a5bcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.682333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af1a1-a952-4d1d-8a40-82c465a5bcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.682607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af1a1-a952-4d1d-8a40-82c465a5bcc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.683379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0af1a1-a952-4d1d-8a40-82c465a5bcc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:54.683684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0af1a1-a952-4d1d-8a40-82c465a5bcc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:54.685269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0af1a1-a952-4d1d-8a40-82c465a5bcc2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:54.691956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c72c3b-1e35-4d83-8b28-3379f7713d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:54.693118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72c3b-1e35-4d83-8b28-3379f7713d48 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.693629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72c3b-1e35-4d83-8b28-3379f7713d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.694094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72c3b-1e35-4d83-8b28-3379f7713d48 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.695099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c72c3b-1e35-4d83-8b28-3379f7713d48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:54.695617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c72c3b-1e35-4d83-8b28-3379f7713d48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:54.697406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c72c3b-1e35-4d83-8b28-3379f7713d48 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:54.700496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 322/634] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:54.701896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0af1a1-a952-4d1d-8a40-82c465a5bcc2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:54.711872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 313/635] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:54.713155 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c72c3b-1e35-4d83-8b28-3379f7713d48 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:54.780064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:54.809271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0af1a1-a952-4d1d-8a40-82c465a5bcc2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:54.815770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c72c3b-1e35-4d83-8b28-3379f7713d48 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:54.825179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:54.845211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2355d-2805-4d7b-80e2-8995ec0fcc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:54.845858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2355d-2805-4d7b-80e2-8995ec0fcc3d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.846130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2355d-2805-4d7b-80e2-8995ec0fcc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.846598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2355d-2805-4d7b-80e2-8995ec0fcc3d None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.847184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2355d-2805-4d7b-80e2-8995ec0fcc3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:54.847490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2355d-2805-4d7b-80e2-8995ec0fcc3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:54.848956 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2355d-2805-4d7b-80e2-8995ec0fcc3d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:54.851509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4a4d-951a-45b1-b564-1b0d23d85c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:54.852333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4a4d-951a-45b1-b564-1b0d23d85c16 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.852617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4a4d-951a-45b1-b564-1b0d23d85c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.852891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4a4d-951a-45b1-b564-1b0d23d85c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.861389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 323/636] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:54.862611 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb2f3-b6fd-46e9-910e-ec253ef9095d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:54.862895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb2f3-b6fd-46e9-910e-ec253ef9095d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:54.863166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb2f3-b6fd-46e9-910e-ec253ef9095d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:54.868696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 324/637] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:54.868696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fb2f3-b6fd-46e9-910e-ec253ef9095d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:54.870507 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4a4d-951a-45b1-b564-1b0d23d85c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:54.873350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab4a4d-951a-45b1-b564-1b0d23d85c16 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8cab4a4d-951a-45b1-b564-1b0d23d85c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:54.895156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:54.896395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:54.897269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:54.897269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:54.897269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:54.897269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:54.897482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 314/638] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:54.898093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4a4d-951a-45b1-b564-1b0d23d85c16 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:54.979362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fb2f3-b6fd-46e9-910e-ec253ef9095d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:55.002852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4a4d-951a-45b1-b564-1b0d23d85c16 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:55.017446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad444f-1f08-4718-b258-83a52dc6c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:55.018446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad444f-1f08-4718-b258-83a52dc6c5e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.018732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad444f-1f08-4718-b258-83a52dc6c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.019002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad444f-1f08-4718-b258-83a52dc6c5e6 None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/7a79a7fbb30b45cd8677d84dd1b5c008/roles/85ff050dde264c0fbb4e9e7efa4c1a34` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.022004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:55.035066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad444f-1f08-4718-b258-83a52dc6c5e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=7a79a7fbb30b45cd8677d84dd1b5c008, role_id=85ff050dde264c0fbb4e9e7efa4c1a34)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:55.036570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad444f-1f08-4718-b258-83a52dc6c5e6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:55.038678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc11a6-f184-4fab-a714-4608708a41d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:55.039343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc11a6-f184-4fab-a714-4608708a41d9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.039627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc11a6-f184-4fab-a714-4608708a41d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.039902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc11a6-f184-4fab-a714-4608708a41d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.040766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc11a6-f184-4fab-a714-4608708a41d9 None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=311b3c1e00d64423865b35a188ede79a) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:55.041181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc11a6-f184-4fab-a714-4608708a41d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:55.043025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc11a6-f184-4fab-a714-4608708a41d9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:55.049508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 315/639] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:54 2022] GET /identity/v3/role_assignments?user.id=311b3c1e00d64423865b35a188ede79a&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:55.060421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 325/640] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:15:54 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/7a79a7fbb30b45cd8677d84dd1b5c008/roles/85ff050dde264c0fbb4e9e7efa4c1a34 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:15:55.060421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad444f-1f08-4718-b258-83a52dc6c5e6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:55.060817 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e16e0-0a23-4986-825b-0f89d88dea97 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.060817 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e16e0-0a23-4986-825b-0f89d88dea97 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.060817 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e16e0-0a23-4986-825b-0f89d88dea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.087393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-422e16e0-0a23-4986-825b-0f89d88dea97 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:55.088812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-422e16e0-0a23-4986-825b-0f89d88dea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:55.113054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:55.180290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 316/641] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:55.181423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad444f-1f08-4718-b258-83a52dc6c5e6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:55.182033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76dac3-7194-47e2-bec5-5074ddf004d8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.182389 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76dac3-7194-47e2-bec5-5074ddf004d8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.182732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76dac3-7194-47e2-bec5-5074ddf004d8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.184782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 317/642] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:55.190632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c560354-342f-40b9-8469-c9baace7959b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.190922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c560354-342f-40b9-8469-c9baace7959b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.191239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c560354-342f-40b9-8469-c9baace7959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.222330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4c560354-342f-40b9-8469-c9baace7959b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:55.223579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4c560354-342f-40b9-8469-c9baace7959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:55.226097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9773f-fd51-4f58-a245-6c65fd73d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:55.227211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9773f-fd51-4f58-a245-6c65fd73d56e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.227691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9773f-fd51-4f58-a245-6c65fd73d56e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.228217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9773f-fd51-4f58-a245-6c65fd73d56e None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.229191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9773f-fd51-4f58-a245-6c65fd73d56e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:55.229694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9773f-fd51-4f58-a245-6c65fd73d56e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:55.231329 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9773f-fd51-4f58-a245-6c65fd73d56e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:55.245528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 326/643] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:55.251480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9773f-fd51-4f58-a245-6c65fd73d56e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:55.315575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:55.334420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 318/644] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:15:55.335307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c560354-342f-40b9-8469-c9baace7959b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:55.394540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9773f-fd51-4f58-a245-6c65fd73d56e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:55.438534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0881f09-485c-4ba6-a0bb-f641c520aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:55.439360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0881f09-485c-4ba6-a0bb-f641c520aca1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.439642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0881f09-485c-4ba6-a0bb-f641c520aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.440047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0881f09-485c-4ba6-a0bb-f641c520aca1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.450175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:55.454261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0881f09-485c-4ba6-a0bb-f641c520aca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d0881f09-485c-4ba6-a0bb-f641c520aca1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:55.462984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:55.464269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:55.465104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 327/645] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:55.465797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0881f09-485c-4ba6-a0bb-f641c520aca1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:55.476522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c560354-342f-40b9-8469-c9baace7959b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:55.515065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208dfe2-db0f-4274-8ec9-5bea2a98b530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:55.516046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208dfe2-db0f-4274-8ec9-5bea2a98b530 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.516512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208dfe2-db0f-4274-8ec9-5bea2a98b530 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.516889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208dfe2-db0f-4274-8ec9-5bea2a98b530 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.525458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208dfe2-db0f-4274-8ec9-5bea2a98b530 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:55.527117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208dfe2-db0f-4274-8ec9-5bea2a98b530 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9208dfe2-db0f-4274-8ec9-5bea2a98b530 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:55.543854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:55.545678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 319/646] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:55.547839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208dfe2-db0f-4274-8ec9-5bea2a98b530 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:55.571932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0881f09-485c-4ba6-a0bb-f641c520aca1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:55.574411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:55.610360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befa2f6-b545-40fa-a8bf-83b31117b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:55.611455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befa2f6-b545-40fa-a8bf-83b31117b485 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.611742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befa2f6-b545-40fa-a8bf-83b31117b485 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.612040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befa2f6-b545-40fa-a8bf-83b31117b485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.627801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befa2f6-b545-40fa-a8bf-83b31117b485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3befa2f6-b545-40fa-a8bf-83b31117b485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:55.639977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:55.642151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 328/647] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:55.643601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befa2f6-b545-40fa-a8bf-83b31117b485 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:55.674481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208dfe2-db0f-4274-8ec9-5bea2a98b530 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:55.728650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709666f5-eff0-4957-ab6a-5c7b60d06c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:55.729776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709666f5-eff0-4957-ab6a-5c7b60d06c4d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.730196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709666f5-eff0-4957-ab6a-5c7b60d06c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.730609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709666f5-eff0-4957-ab6a-5c7b60d06c4d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.731830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709666f5-eff0-4957-ab6a-5c7b60d06c4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:55.732586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709666f5-eff0-4957-ab6a-5c7b60d06c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:55.734296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709666f5-eff0-4957-ab6a-5c7b60d06c4d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:55.745470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 320/648] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:55.746590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709666f5-eff0-4957-ab6a-5c7b60d06c4d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:55.764458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:55.787919 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befa2f6-b545-40fa-a8bf-83b31117b485 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:55.832220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17bb4f-81c0-45f7-8e40-b09137538018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:55.833581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17bb4f-81c0-45f7-8e40-b09137538018 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.834082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17bb4f-81c0-45f7-8e40-b09137538018 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.834872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17bb4f-81c0-45f7-8e40-b09137538018 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.836650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17bb4f-81c0-45f7-8e40-b09137538018 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:55.837476 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17bb4f-81c0-45f7-8e40-b09137538018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:55.840620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17bb4f-81c0-45f7-8e40-b09137538018 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:55.866091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709666f5-eff0-4957-ab6a-5c7b60d06c4d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:55.866999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 329/649] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 4 18:15:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:55.868355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17bb4f-81c0-45f7-8e40-b09137538018 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:55.900648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:55.908367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79077390-0bc4-4315-b16d-8c3dd9258c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:55.909295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79077390-0bc4-4315-b16d-8c3dd9258c84 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:55.909871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79077390-0bc4-4315-b16d-8c3dd9258c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:55.910317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79077390-0bc4-4315-b16d-8c3dd9258c84 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:55.911567 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79077390-0bc4-4315-b16d-8c3dd9258c84 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:55.912296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79077390-0bc4-4315-b16d-8c3dd9258c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:55.913836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79077390-0bc4-4315-b16d-8c3dd9258c84 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:55.929494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 321/650] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:55.929494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79077390-0bc4-4315-b16d-8c3dd9258c84 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:56.006505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17bb4f-81c0-45f7-8e40-b09137538018 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:56.019139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:56.052225 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417623d-977d-41d8-837e-74377308c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:56.053374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417623d-977d-41d8-837e-74377308c826 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:56.054040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417623d-977d-41d8-837e-74377308c826 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:56.054577 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417623d-977d-41d8-837e-74377308c826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:56.065654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79077390-0bc4-4315-b16d-8c3dd9258c84 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:56.071094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417623d-977d-41d8-837e-74377308c826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:56.072704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417623d-977d-41d8-837e-74377308c826 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-0417623d-977d-41d8-837e-74377308c826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:56.093710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:56.094664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:56.095532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:56.095532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:56.095532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:56.095532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:56.100254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 330/651] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:56.101172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417623d-977d-41d8-837e-74377308c826 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:56.116700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ad54a-8c89-4726-9a45-693ef3fc2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:56.117658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad54a-8c89-4726-9a45-693ef3fc2376 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:56.118151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad54a-8c89-4726-9a45-693ef3fc2376 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:56.118605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ad54a-8c89-4726-9a45-693ef3fc2376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:56.197114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:56.220056 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ad54a-8c89-4726-9a45-693ef3fc2376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:56.223485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ad54a-8c89-4726-9a45-693ef3fc2376 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:56.230123 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417623d-977d-41d8-837e-74377308c826 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:56.272071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4709faf-3e1f-4329-9f97-53b3142edf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:56.273318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4709faf-3e1f-4329-9f97-53b3142edf7d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:56.273778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4709faf-3e1f-4329-9f97-53b3142edf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:56.274300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4709faf-3e1f-4329-9f97-53b3142edf7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:56.289413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4709faf-3e1f-4329-9f97-53b3142edf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:56.293607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4709faf-3e1f-4329-9f97-53b3142edf7d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d4709faf-3e1f-4329-9f97-53b3142edf7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:56.322182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:56.323150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:56.324045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:56.324045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:56.324045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:56.324045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:56.328798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 331/652] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:56.329806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4709faf-3e1f-4329-9f97-53b3142edf7d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:56.342674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:56.405543 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 322/653] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:56.407485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ad54a-8c89-4726-9a45-693ef3fc2376 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:56.464617 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4709faf-3e1f-4329-9f97-53b3142edf7d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:56.499797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:56.515497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2548c5-5649-4bf3-a9d9-41a64fbdd2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:56.516628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2548c5-5649-4bf3-a9d9-41a64fbdd2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:56.517006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2548c5-5649-4bf3-a9d9-41a64fbdd2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:56.517373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2548c5-5649-4bf3-a9d9-41a64fbdd2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:56.518205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2548c5-5649-4bf3-a9d9-41a64fbdd2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:56.518865 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2548c5-5649-4bf3-a9d9-41a64fbdd2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:56.521608 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2548c5-5649-4bf3-a9d9-41a64fbdd2a8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:56.540090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 332/654] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:56.541226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2548c5-5649-4bf3-a9d9-41a64fbdd2a8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:56.545634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ad54a-8c89-4726-9a45-693ef3fc2376 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:56.582717 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f3906-8412-489b-96d7-6c9b7d0c7d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:56.583653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f3906-8412-489b-96d7-6c9b7d0c7d96 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:56.584107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f3906-8412-489b-96d7-6c9b7d0c7d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:56.584545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f3906-8412-489b-96d7-6c9b7d0c7d96 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:56.585424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f3906-8412-489b-96d7-6c9b7d0c7d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:56.585873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f3906-8412-489b-96d7-6c9b7d0c7d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:56.587393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f3906-8412-489b-96d7-6c9b7d0c7d96 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:56.599888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 323/655] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:56.601001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f3906-8412-489b-96d7-6c9b7d0c7d96 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:56.630832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:56.673256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2548c5-5649-4bf3-a9d9-41a64fbdd2a8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:56.712135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c7005-ea27-47a5-b263-cc23b3c5d85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:56.712915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f3906-8412-489b-96d7-6c9b7d0c7d96 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:56.713191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c7005-ea27-47a5-b263-cc23b3c5d85a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:56.713561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c7005-ea27-47a5-b263-cc23b3c5d85a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:56.713927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c7005-ea27-47a5-b263-cc23b3c5d85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:56.728131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c7005-ea27-47a5-b263-cc23b3c5d85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:56.730468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c7005-ea27-47a5-b263-cc23b3c5d85a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-273c7005-ea27-47a5-b263-cc23b3c5d85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:56.751093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:56.752222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:56.753101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:56.753101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:56.753101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:56.753101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:56.753317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0be6fc-6f33-44a7-9685-4bb734ff8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:56.753317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0be6fc-6f33-44a7-9685-4bb734ff8e40 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:56.753317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0be6fc-6f33-44a7-9685-4bb734ff8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:56.753538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0be6fc-6f33-44a7-9685-4bb734ff8e40 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:56.755575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 333/656] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:56.756579 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c7005-ea27-47a5-b263-cc23b3c5d85a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:56.763731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0be6fc-6f33-44a7-9685-4bb734ff8e40 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:56.765324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0be6fc-6f33-44a7-9685-4bb734ff8e40 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ca0be6fc-6f33-44a7-9685-4bb734ff8e40 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:56.784474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:56.785443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:56.786358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:56.786358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:56.786358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:56.786358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:56.786358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:56.786358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:56.786358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:56.786358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:56.786358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 18:15:56.786358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:56.790711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 324/657] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:56.791285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0be6fc-6f33-44a7-9685-4bb734ff8e40 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:56.803375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:56.865986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c7005-ea27-47a5-b263-cc23b3c5d85a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:56.888640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:56.901964 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76951496-44f7-4f6f-9b57-9beefd50294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:56.903104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76951496-44f7-4f6f-9b57-9beefd50294d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:56.903282 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0be6fc-6f33-44a7-9685-4bb734ff8e40 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:56.903769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76951496-44f7-4f6f-9b57-9beefd50294d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:56.904491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76951496-44f7-4f6f-9b57-9beefd50294d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:56.913954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76951496-44f7-4f6f-9b57-9beefd50294d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:56.915730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76951496-44f7-4f6f-9b57-9beefd50294d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-76951496-44f7-4f6f-9b57-9beefd50294d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:56.931755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:56.932738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:56.933654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:56.933654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:56.933654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:56.933654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:56.933654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:56.933654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:56.933654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:56.933654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:56.933654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 18:15:56.933654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:56.936426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 334/658] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:56.937695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76951496-44f7-4f6f-9b57-9beefd50294d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:56.939259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f3ac-6bab-404b-930d-59d3cdf40f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:56.939941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f3ac-6bab-404b-930d-59d3cdf40f2c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:56.940248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f3ac-6bab-404b-930d-59d3cdf40f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:56.940586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f3ac-6bab-404b-930d-59d3cdf40f2c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:56.941330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f3ac-6bab-404b-930d-59d3cdf40f2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:56.941634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f3ac-6bab-404b-930d-59d3cdf40f2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:56.943903 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f3ac-6bab-404b-930d-59d3cdf40f2c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:56.956924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 325/659] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:56.957822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f3ac-6bab-404b-930d-59d3cdf40f2c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:57.041964 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:57.046477 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76951496-44f7-4f6f-9b57-9beefd50294d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:57.068171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f3ac-6bab-404b-930d-59d3cdf40f2c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:57.084571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d2a81-5eae-4401-b06b-d49a27c832bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:57.085258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d2a81-5eae-4401-b06b-d49a27c832bf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.085541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d2a81-5eae-4401-b06b-d49a27c832bf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.085819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d2a81-5eae-4401-b06b-d49a27c832bf None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.086676 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d2a81-5eae-4401-b06b-d49a27c832bf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:57.086988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d2a81-5eae-4401-b06b-d49a27c832bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:57.088471 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d2a81-5eae-4401-b06b-d49a27c832bf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:57.110470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd14bcb-00ca-4adf-9bb4-c3ece8867458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:57.111276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 335/660] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Jun 4 18:15:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:57.111819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd14bcb-00ca-4adf-9bb4-c3ece8867458 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.112251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d2a81-5eae-4401-b06b-d49a27c832bf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:57.112539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd14bcb-00ca-4adf-9bb4-c3ece8867458 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.113082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd14bcb-00ca-4adf-9bb4-c3ece8867458 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.114126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd14bcb-00ca-4adf-9bb4-c3ece8867458 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:57.114693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd14bcb-00ca-4adf-9bb4-c3ece8867458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:57.116563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd14bcb-00ca-4adf-9bb4-c3ece8867458 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:57.136507 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 326/661] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Jun 4 18:15:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:57.137785 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd14bcb-00ca-4adf-9bb4-c3ece8867458 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:57.147364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:57.217827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d2a81-5eae-4401-b06b-d49a27c832bf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:57.254143 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd14bcb-00ca-4adf-9bb4-c3ece8867458 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:57.262594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b2c54-70e2-477e-86f3-288f054e5c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:57.263571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b2c54-70e2-477e-86f3-288f054e5c23 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.263848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b2c54-70e2-477e-86f3-288f054e5c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.264170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b2c54-70e2-477e-86f3-288f054e5c23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.271623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b2c54-70e2-477e-86f3-288f054e5c23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:57.273131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b2c54-70e2-477e-86f3-288f054e5c23 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-564b2c54-70e2-477e-86f3-288f054e5c23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:57.287802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:57.288863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:57.289804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:57.289804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:57.289804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:57.289804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:57.289804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:57.289804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:57.289804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:57.289804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:57.289804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 336/662] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:57.290828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b2c54-70e2-477e-86f3-288f054e5c23 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:57.307484 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bfce5-658c-45e3-88d4-be3df7422e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:57.308424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bfce5-658c-45e3-88d4-be3df7422e2d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.308918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bfce5-658c-45e3-88d4-be3df7422e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.309404 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:57.309888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bfce5-658c-45e3-88d4-be3df7422e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.384580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bfce5-658c-45e3-88d4-be3df7422e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:57.387040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bfce5-658c-45e3-88d4-be3df7422e2d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:57.395992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:57.397695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b2c54-70e2-477e-86f3-288f054e5c23 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:57.435063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ae381-afbe-4a2a-b8ba-83aa0d30ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:57.436152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ae381-afbe-4a2a-b8ba-83aa0d30ad6c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.436739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ae381-afbe-4a2a-b8ba-83aa0d30ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.437288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ae381-afbe-4a2a-b8ba-83aa0d30ad6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.499527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 327/663] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:57.499527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bfce5-658c-45e3-88d4-be3df7422e2d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:57.516060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ae381-afbe-4a2a-b8ba-83aa0d30ad6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:57.517962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ae381-afbe-4a2a-b8ba-83aa0d30ad6c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:57.537061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:57.598876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bfce5-658c-45e3-88d4-be3df7422e2d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:57.606452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:57.627841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 337/664] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:15:57.627841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ae381-afbe-4a2a-b8ba-83aa0d30ad6c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:57.638746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd2763-46c9-40fa-9d86-fbe6f3d3e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:57.639418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd2763-46c9-40fa-9d86-fbe6f3d3e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.639699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd2763-46c9-40fa-9d86-fbe6f3d3e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.639965 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd2763-46c9-40fa-9d86-fbe6f3d3e4f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.640789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd2763-46c9-40fa-9d86-fbe6f3d3e4f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:57.641091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd2763-46c9-40fa-9d86-fbe6f3d3e4f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:57.642550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd2763-46c9-40fa-9d86-fbe6f3d3e4f4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:57.654233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 328/665] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:57.655500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35099bc1-4ae9-4c39-8245-fc827d09fef8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.655779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35099bc1-4ae9-4c39-8245-fc827d09fef8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.656082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35099bc1-4ae9-4c39-8245-fc827d09fef8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.657319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 329/666] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:57.658369 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea86d2-b63b-43f0-a27f-0384453bd7ca None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.658655 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea86d2-b63b-43f0-a27f-0384453bd7ca None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.658925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea86d2-b63b-43f0-a27f-0384453bd7ca None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.661648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 330/667] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:15:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:15:57.661648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea86d2-b63b-43f0-a27f-0384453bd7ca None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:57.738979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ae381-afbe-4a2a-b8ba-83aa0d30ad6c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:57.756658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:57.767550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea86d2-b63b-43f0-a27f-0384453bd7ca None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:57.775106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940c553-04e7-485c-bab9-d4fc9432b4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:57.775910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940c553-04e7-485c-bab9-d4fc9432b4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.776222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940c553-04e7-485c-bab9-d4fc9432b4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.776497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940c553-04e7-485c-bab9-d4fc9432b4b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.787054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940c553-04e7-485c-bab9-d4fc9432b4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:57.788557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940c553-04e7-485c-bab9-d4fc9432b4b5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:57.800930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98ee65-b836-4ef9-bd4f-eeb85317dd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:57.801720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98ee65-b836-4ef9-bd4f-eeb85317dd03 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.802002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98ee65-b836-4ef9-bd4f-eeb85317dd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.802272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98ee65-b836-4ef9-bd4f-eeb85317dd03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-9940c553-04e7-485c-bab9-d4fc9432b4b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:57.806501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:57.807376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:57.808266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:57.808266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:57.808266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:57.808266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:57.808266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 338/668] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:57.808556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940c553-04e7-485c-bab9-d4fc9432b4b5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:57.816246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98ee65-b836-4ef9-bd4f-eeb85317dd03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:57.817720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98ee65-b836-4ef9-bd4f-eeb85317dd03 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0c98ee65-b836-4ef9-bd4f-eeb85317dd03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:57.835521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:57.836489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:57.837377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:57.837377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:57.837377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:57.837377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:57.837377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 331/669] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:57.837892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec75952-d1f4-48fc-b92e-4b56762d5691 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.838178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec75952-d1f4-48fc-b92e-4b56762d5691 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.838448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec75952-d1f4-48fc-b92e-4b56762d5691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.855215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-aec75952-d1f4-48fc-b92e-4b56762d5691 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:57.856469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aec75952-d1f4-48fc-b92e-4b56762d5691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:57.870690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:57.914299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940c553-04e7-485c-bab9-d4fc9432b4b5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:57.927183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 332/670] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:57.928523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac8f2c-63e1-4e0f-89a8-1af411c95e85 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.928813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac8f2c-63e1-4e0f-89a8-1af411c95e85 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.929089 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac8f2c-63e1-4e0f-89a8-1af411c95e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.946202 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dfac8f2c-63e1-4e0f-89a8-1af411c95e85 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:15:57.947424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dfac8f2c-63e1-4e0f-89a8-1af411c95e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:15:57.957475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16ec01-beb3-41db-9655-4af8ec95ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:57.958148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16ec01-beb3-41db-9655-4af8ec95ef6a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:57.958430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16ec01-beb3-41db-9655-4af8ec95ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:57.958706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16ec01-beb3-41db-9655-4af8ec95ef6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:57.959552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16ec01-beb3-41db-9655-4af8ec95ef6a None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=3b4adc107bf542b8bb0502c7fbf94431) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:57.959868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16ec01-beb3-41db-9655-4af8ec95ef6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:57.961385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16ec01-beb3-41db-9655-4af8ec95ef6a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:57.967387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 339/671] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:57 2022] GET /identity/v3/role_assignments?user.id=3b4adc107bf542b8bb0502c7fbf94431&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:57.968205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16ec01-beb3-41db-9655-4af8ec95ef6a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.016975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:58.029061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 333/672] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:15:58.030241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac8f2c-63e1-4e0f-89a8-1af411c95e85 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.104500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16ec01-beb3-41db-9655-4af8ec95ef6a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.126140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:58.144154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2856db5-4ae2-4c9a-974b-55661aa4a7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.144845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856db5-4ae2-4c9a-974b-55661aa4a7ce None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.145127 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856db5-4ae2-4c9a-974b-55661aa4a7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.145405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2856db5-4ae2-4c9a-974b-55661aa4a7ce None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:58.146150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856db5-4ae2-4c9a-974b-55661aa4a7ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:58.146456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856db5-4ae2-4c9a-974b-55661aa4a7ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:58.147873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2856db5-4ae2-4c9a-974b-55661aa4a7ce None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:58.151051 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac8f2c-63e1-4e0f-89a8-1af411c95e85 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.160733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 340/673] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:58.165918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2856db5-4ae2-4c9a-974b-55661aa4a7ce None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.199801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04590b4-794c-48ab-89d5-c7bd9bb93c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.200501 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04590b4-794c-48ab-89d5-c7bd9bb93c1b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.200782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04590b4-794c-48ab-89d5-c7bd9bb93c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.201056 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04590b4-794c-48ab-89d5-c7bd9bb93c1b None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:58.201787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04590b4-794c-48ab-89d5-c7bd9bb93c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:58.203285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04590b4-794c-48ab-89d5-c7bd9bb93c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:58.203474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04590b4-794c-48ab-89d5-c7bd9bb93c1b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:58.215632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 334/674] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:58.216948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04590b4-794c-48ab-89d5-c7bd9bb93c1b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.274565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:58.284273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2856db5-4ae2-4c9a-974b-55661aa4a7ce None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.319302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5b598-3cf3-4922-b252-bd7a8e3e3e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.320143 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5b598-3cf3-4922-b252-bd7a8e3e3e80 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.320429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5b598-3cf3-4922-b252-bd7a8e3e3e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.320708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5b598-3cf3-4922-b252-bd7a8e3e3e80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:58.331349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5b598-3cf3-4922-b252-bd7a8e3e3e80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:58.334145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04590b4-794c-48ab-89d5-c7bd9bb93c1b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8cb5b598-3cf3-4922-b252-bd7a8e3e3e80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:58.338953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:58.340030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:58.340901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 341/675] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:58.341739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5b598-3cf3-4922-b252-bd7a8e3e3e80 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.373578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f3af1-54e5-4218-888f-d8af5cfba014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.374384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3af1-54e5-4218-888f-d8af5cfba014 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.374673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3af1-54e5-4218-888f-d8af5cfba014 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.374949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3af1-54e5-4218-888f-d8af5cfba014 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:58.382940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:58.390063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f3af1-54e5-4218-888f-d8af5cfba014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-fb5f3af1-54e5-4218-888f-d8af5cfba014 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:15:58.397784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:58.398690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:58.399518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 335/676] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:58.400760 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f3af1-54e5-4218-888f-d8af5cfba014 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.462821 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5b598-3cf3-4922-b252-bd7a8e3e3e80 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.499249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f91a3-5484-478b-81f5-0e00ce7bdc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.500084 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f91a3-5484-478b-81f5-0e00ce7bdc1b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.500367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f91a3-5484-478b-81f5-0e00ce7bdc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.500642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f91a3-5484-478b-81f5-0e00ce7bdc1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:58.508376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f91a3-5484-478b-81f5-0e00ce7bdc1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:58.510139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f91a3-5484-478b-81f5-0e00ce7bdc1b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:58.510514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f3af1-54e5-4218-888f-d8af5cfba014 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-483f91a3-5484-478b-81f5-0e00ce7bdc1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:58.525177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:58.526077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:58.526980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:58.526980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:58.526980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:58.526980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:58.526980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:58.526980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:58.526980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:58.526980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:58.526980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 342/677] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:58.527454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f91a3-5484-478b-81f5-0e00ce7bdc1b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.544876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:58.553291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858fd8d-03d2-4fc1-83a0-3341b138d1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.554124 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858fd8d-03d2-4fc1-83a0-3341b138d1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.554412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858fd8d-03d2-4fc1-83a0-3341b138d1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.554666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858fd8d-03d2-4fc1-83a0-3341b138d1e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:58.562735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858fd8d-03d2-4fc1-83a0-3341b138d1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:58.564225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858fd8d-03d2-4fc1-83a0-3341b138d1e7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3858fd8d-03d2-4fc1-83a0-3341b138d1e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:15:58.578157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:58.579059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:58.579960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:15:58.579960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:15:58.579960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:15:58.579960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:15:58.579960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:15:58.579960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:15:58.579960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:15:58.579960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:58.584044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 336/678] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:58.584890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858fd8d-03d2-4fc1-83a0-3341b138d1e7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.638197 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f91a3-5484-478b-81f5-0e00ce7bdc1b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.645198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:58.674175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06122-5af0-45c6-b49f-ae83c4cf27be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.674902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06122-5af0-45c6-b49f-ae83c4cf27be None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.675184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06122-5af0-45c6-b49f-ae83c4cf27be None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.675456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06122-5af0-45c6-b49f-ae83c4cf27be None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:58.676278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b06122-5af0-45c6-b49f-ae83c4cf27be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:58.676599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b06122-5af0-45c6-b49f-ae83c4cf27be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:58.677974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b06122-5af0-45c6-b49f-ae83c4cf27be None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:58.686286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 343/679] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:58.686940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06122-5af0-45c6-b49f-ae83c4cf27be None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.696480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858fd8d-03d2-4fc1-83a0-3341b138d1e7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.730840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477a03-e325-4415-82d6-6679dcadde1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.731935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477a03-e325-4415-82d6-6679dcadde1b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.732399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477a03-e325-4415-82d6-6679dcadde1b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.733362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477a03-e325-4415-82d6-6679dcadde1b None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:58.734132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86477a03-e325-4415-82d6-6679dcadde1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:58.734442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86477a03-e325-4415-82d6-6679dcadde1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:58.735823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86477a03-e325-4415-82d6-6679dcadde1b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:58.744969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 337/680] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:58.745591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477a03-e325-4415-82d6-6679dcadde1b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.770417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:58.799326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06122-5af0-45c6-b49f-ae83c4cf27be None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.833405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6b257-0081-4330-8667-201d490f6741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.834068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6b257-0081-4330-8667-201d490f6741 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.834346 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6b257-0081-4330-8667-201d490f6741 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.834619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6b257-0081-4330-8667-201d490f6741 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:58.835406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6b257-0081-4330-8667-201d490f6741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:58.835714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6b257-0081-4330-8667-201d490f6741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:58.837306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6b257-0081-4330-8667-201d490f6741 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:58.849371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477a03-e325-4415-82d6-6679dcadde1b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.854848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 344/681] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:58.854848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6b257-0081-4330-8667-201d490f6741 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.877426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:58.892826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e961f47-2f6a-42d7-9b50-faa613ca2ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.893489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e961f47-2f6a-42d7-9b50-faa613ca2ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.893774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e961f47-2f6a-42d7-9b50-faa613ca2ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.894050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e961f47-2f6a-42d7-9b50-faa613ca2ff2 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:58.894836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e961f47-2f6a-42d7-9b50-faa613ca2ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:58.895142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e961f47-2f6a-42d7-9b50-faa613ca2ff2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:58.896626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e961f47-2f6a-42d7-9b50-faa613ca2ff2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:58.908422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 338/682] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:58.909199 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e961f47-2f6a-42d7-9b50-faa613ca2ff2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:58.961887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6b257-0081-4330-8667-201d490f6741 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:58.996941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e8348-b1d8-4727-adb9-9cae5f88a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:58.998024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e8348-b1d8-4727-adb9-9cae5f88a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:58.998374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e8348-b1d8-4727-adb9-9cae5f88a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:58.998927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e8348-b1d8-4727-adb9-9cae5f88a7c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:59.000852 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:59.012731 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e8348-b1d8-4727-adb9-9cae5f88a7c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:59.013213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e961f47-2f6a-42d7-9b50-faa613ca2ff2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:59.014283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e8348-b1d8-4727-adb9-9cae5f88a7c6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f92e8348-b1d8-4727-adb9-9cae5f88a7c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:59.034020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:59.034927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:59.035789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:59.035789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:59.035789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:59.035789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:59.035789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 345/683] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:59.036555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e8348-b1d8-4727-adb9-9cae5f88a7c6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:59.053201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a5642-e133-4138-9968-72652cf26a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:59.053972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a5642-e133-4138-9968-72652cf26a88 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:59.054256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a5642-e133-4138-9968-72652cf26a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:59.054530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a5642-e133-4138-9968-72652cf26a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:59.065188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a5642-e133-4138-9968-72652cf26a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:59.066648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a5642-e133-4138-9968-72652cf26a88 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e52a5642-e133-4138-9968-72652cf26a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:15:59.083664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:59.084657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:59.085520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:15:59.085520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:15:59.085520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:15:59.085520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:59.089445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 339/684] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:59.090263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a5642-e133-4138-9968-72652cf26a88 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:59.120975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:59.149576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e8348-b1d8-4727-adb9-9cae5f88a7c6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:59.185468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8a38-024c-4e3b-8c92-dd727b0064f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:59.186136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8a38-024c-4e3b-8c92-dd727b0064f4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:59.186424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8a38-024c-4e3b-8c92-dd727b0064f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:59.186704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf8a38-024c-4e3b-8c92-dd727b0064f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:59.187558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf8a38-024c-4e3b-8c92-dd727b0064f4 None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=37c4400204794a54957ccf28df938f46) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:59.187872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf8a38-024c-4e3b-8c92-dd727b0064f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:59.189371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf8a38-024c-4e3b-8c92-dd727b0064f4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:59.196037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 346/685] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:59 2022] GET /identity/v3/role_assignments?user.id=37c4400204794a54957ccf28df938f46&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:59.196686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8a38-024c-4e3b-8c92-dd727b0064f4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:59.204539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a5642-e133-4138-9968-72652cf26a88 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:59.253697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1814d-d402-4e4d-abb4-451209c754b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:59.254370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1814d-d402-4e4d-abb4-451209c754b5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:59.255537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1814d-d402-4e4d-abb4-451209c754b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:59.255826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1814d-d402-4e4d-abb4-451209c754b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:59.256758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1814d-d402-4e4d-abb4-451209c754b5 None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=43023787db0749e8be546755f521755b) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:59.257076 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1814d-d402-4e4d-abb4-451209c754b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:59.258695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1814d-d402-4e4d-abb4-451209c754b5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:59.259588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:59.267283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 340/686] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:15:59 2022] GET /identity/v3/role_assignments?user.id=43023787db0749e8be546755f521755b&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:59.268339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1814d-d402-4e4d-abb4-451209c754b5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:59.337058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf8a38-024c-4e3b-8c92-dd727b0064f4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:59.387307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:59.390974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ff51-d04f-4a20-99d4-0af68416f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:59.392921 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ff51-d04f-4a20-99d4-0af68416f356 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:59.393450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ff51-d04f-4a20-99d4-0af68416f356 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:59.393937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ff51-d04f-4a20-99d4-0af68416f356 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:59.394759 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1814d-d402-4e4d-abb4-451209c754b5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:59.395473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ff51-d04f-4a20-99d4-0af68416f356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:59.395923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ff51-d04f-4a20-99d4-0af68416f356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:59.398404 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ff51-d04f-4a20-99d4-0af68416f356 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:59.420641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 347/687] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:59.424025 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ff51-d04f-4a20-99d4-0af68416f356 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:59.438903 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82603027-9e8b-4c42-a89a-fba7154bcea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:59.439635 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603027-9e8b-4c42-a89a-fba7154bcea8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:59.439921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603027-9e8b-4c42-a89a-fba7154bcea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:59.440233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603027-9e8b-4c42-a89a-fba7154bcea8 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:59.441044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82603027-9e8b-4c42-a89a-fba7154bcea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:59.441356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82603027-9e8b-4c42-a89a-fba7154bcea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:59.442822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82603027-9e8b-4c42-a89a-fba7154bcea8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:59.461776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 341/688] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:59.473603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82603027-9e8b-4c42-a89a-fba7154bcea8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:59.574682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ff51-d04f-4a20-99d4-0af68416f356 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:59.587287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:59.622936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712b126-84b8-4aa3-b79f-7d9f4bb7be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:59.623769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712b126-84b8-4aa3-b79f-7d9f4bb7be23 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:59.624164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712b126-84b8-4aa3-b79f-7d9f4bb7be23 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:59.624444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712b126-84b8-4aa3-b79f-7d9f4bb7be23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:59.624942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82603027-9e8b-4c42-a89a-fba7154bcea8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:59.639181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712b126-84b8-4aa3-b79f-7d9f4bb7be23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:59.639181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712b126-84b8-4aa3-b79f-7d9f4bb7be23 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-0712b126-84b8-4aa3-b79f-7d9f4bb7be23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:59.657586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:59.658638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:15:59.659875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 348/689] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 4 18:15:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:15:59.664797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712b126-84b8-4aa3-b79f-7d9f4bb7be23 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:59.683971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2f315-009d-4651-8e5d-452448e1ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:59.685296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f315-009d-4651-8e5d-452448e1ab93 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:59.685793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f315-009d-4651-8e5d-452448e1ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:59.686390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2f315-009d-4651-8e5d-452448e1ab93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:59.696724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2f315-009d-4651-8e5d-452448e1ab93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:59.699119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2f315-009d-4651-8e5d-452448e1ab93 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-82a2f315-009d-4651-8e5d-452448e1ab93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:15:59.718967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:15:59.719949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:15:59.721415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 342/690] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:15:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:15:59.727893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2f315-009d-4651-8e5d-452448e1ab93 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:59.746607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:59.790565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712b126-84b8-4aa3-b79f-7d9f4bb7be23 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:15:59.829927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfeefa-f70d-4888-ab28-fa1a2f65fe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:15:59.830532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfeefa-f70d-4888-ab28-fa1a2f65fe12 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:15:59.830815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfeefa-f70d-4888-ab28-fa1a2f65fe12 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:15:59.831085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfeefa-f70d-4888-ab28-fa1a2f65fe12 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:15:59.831954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfeefa-f70d-4888-ab28-fa1a2f65fe12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:15:59.832454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfeefa-f70d-4888-ab28-fa1a2f65fe12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:15:59.834202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfeefa-f70d-4888-ab28-fa1a2f65fe12 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:15:59.855619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 349/691] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 4 18:15:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:15:59.861280 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfeefa-f70d-4888-ab28-fa1a2f65fe12 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:15:59.906642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:15:59.941081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2f315-009d-4651-8e5d-452448e1ab93 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:00.022055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfeefa-f70d-4888-ab28-fa1a2f65fe12 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:00.031435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffdc5a-61c1-4ddb-97db-bf171632b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:00.032226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffdc5a-61c1-4ddb-97db-bf171632b73c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:00.032515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffdc5a-61c1-4ddb-97db-bf171632b73c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:00.032793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffdc5a-61c1-4ddb-97db-bf171632b73c None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:00.033668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffdc5a-61c1-4ddb-97db-bf171632b73c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:00.033983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffdc5a-61c1-4ddb-97db-bf171632b73c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:00.035487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffdc5a-61c1-4ddb-97db-bf171632b73c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:00.058794 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 343/692] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 4 18:15:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:00.066090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffdc5a-61c1-4ddb-97db-bf171632b73c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:00.096266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b4f7e-5107-4b4c-baf6-dfa8c93f6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:00.096849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b4f7e-5107-4b4c-baf6-dfa8c93f6ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:00.097132 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b4f7e-5107-4b4c-baf6-dfa8c93f6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:00.097409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b4f7e-5107-4b4c-baf6-dfa8c93f6ba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:00.150423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:00.179642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffdc5a-61c1-4ddb-97db-bf171632b73c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:00.218260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d840af5-da5c-4b39-b6cb-0ae6946611d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:00.219125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d840af5-da5c-4b39-b6cb-0ae6946611d9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:00.219413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d840af5-da5c-4b39-b6cb-0ae6946611d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:00.219689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d840af5-da5c-4b39-b6cb-0ae6946611d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:00.269709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b4f7e-5107-4b4c-baf6-dfa8c93f6ba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:00.271200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b4f7e-5107-4b4c-baf6-dfa8c93f6ba6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:00.331019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:00.362989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d840af5-da5c-4b39-b6cb-0ae6946611d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:00.364433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d840af5-da5c-4b39-b6cb-0ae6946611d9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:00.429640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 350/693] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 18:16:00.431011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635f35-ff99-43b1-a9b4-87ce92fd4aef None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:00.431295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635f35-ff99-43b1-a9b4-87ce92fd4aef None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:00.431569 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28635f35-ff99-43b1-a9b4-87ce92fd4aef None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:00.436758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 351/694] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:00.437024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28635f35-ff99-43b1-a9b4-87ce92fd4aef None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:00.449841 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:00.477161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 344/695] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 18:16:00.478599 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc8817-7409-4a45-bddc-18a1a29b95e4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:00.479008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc8817-7409-4a45-bddc-18a1a29b95e4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:00.479386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc8817-7409-4a45-bddc-18a1a29b95e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:00.495756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dcdc8817-7409-4a45-bddc-18a1a29b95e4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:00.497131 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dcdc8817-7409-4a45-bddc-18a1a29b95e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:00.555655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28635f35-ff99-43b1-a9b4-87ce92fd4aef None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:00.580200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 345/696] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:16:00.581164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc8817-7409-4a45-bddc-18a1a29b95e4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:00.590609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:00.606043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46efe3-2553-4887-bbb0-a7ca8992eb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:00.606889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46efe3-2553-4887-bbb0-a7ca8992eb85 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:00.607200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46efe3-2553-4887-bbb0-a7ca8992eb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:00.607476 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46efe3-2553-4887-bbb0-a7ca8992eb85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:00.625869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46efe3-2553-4887-bbb0-a7ca8992eb85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:00.627269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46efe3-2553-4887-bbb0-a7ca8992eb85 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4a46efe3-2553-4887-bbb0-a7ca8992eb85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:00.646178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:00.647058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:00.648847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:00.648847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:00.648847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:00.648847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:00.648847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 352/697] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:00.648847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46efe3-2553-4887-bbb0-a7ca8992eb85 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:00.709055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc8817-7409-4a45-bddc-18a1a29b95e4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:00.712749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:00.750109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae73967-40e6-4dd0-9247-d48f6462e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:00.750767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae73967-40e6-4dd0-9247-d48f6462e9aa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:00.751049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae73967-40e6-4dd0-9247-d48f6462e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:00.751320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae73967-40e6-4dd0-9247-d48f6462e9aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:00.762882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae73967-40e6-4dd0-9247-d48f6462e9aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:00.764726 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae73967-40e6-4dd0-9247-d48f6462e9aa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:00.775485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46efe3-2553-4887-bbb0-a7ca8992eb85 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2ae73967-40e6-4dd0-9247-d48f6462e9aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:00.782857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:00.783786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:00.784991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:00.784991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:00.784991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:00.784991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:00.784991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 346/698] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:00.785266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae73967-40e6-4dd0-9247-d48f6462e9aa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:00.823366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e61a5f-f5b2-4b15-b6a2-34193a120fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:00.824591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e61a5f-f5b2-4b15-b6a2-34193a120fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:00.825078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e61a5f-f5b2-4b15-b6a2-34193a120fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:00.825552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e61a5f-f5b2-4b15-b6a2-34193a120fa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:00.840541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e61a5f-f5b2-4b15-b6a2-34193a120fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:00.842269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e61a5f-f5b2-4b15-b6a2-34193a120fa5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-90e61a5f-f5b2-4b15-b6a2-34193a120fa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:00.860622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:00.861603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:00.862499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:00.862499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:00.862499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:00.862499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:00.866698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 353/699] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:00.867612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e61a5f-f5b2-4b15-b6a2-34193a120fa5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:00.905427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:00.906406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae73967-40e6-4dd0-9247-d48f6462e9aa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:00.943919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc3c9d-bf46-474e-b730-d085dfd88ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:00.944502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3c9d-bf46-474e-b730-d085dfd88ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:00.944783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3c9d-bf46-474e-b730-d085dfd88ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:00.945062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc3c9d-bf46-474e-b730-d085dfd88ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:00.945825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc3c9d-bf46-474e-b730-d085dfd88ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:00.946079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc3c9d-bf46-474e-b730-d085dfd88ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:00.947574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc3c9d-bf46-474e-b730-d085dfd88ad9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:00.965467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 347/700] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:00.965467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc3c9d-bf46-474e-b730-d085dfd88ad9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:00.981893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:01.004806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e61a5f-f5b2-4b15-b6a2-34193a120fa5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:01.052814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9973c-2996-4406-b4c8-d5d79a71727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:01.054237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9973c-2996-4406-b4c8-d5d79a71727f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.054726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9973c-2996-4406-b4c8-d5d79a71727f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.055201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9973c-2996-4406-b4c8-d5d79a71727f None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.056685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9973c-2996-4406-b4c8-d5d79a71727f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:01.057198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9973c-2996-4406-b4c8-d5d79a71727f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:01.059408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9973c-2996-4406-b4c8-d5d79a71727f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:01.068627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc3c9d-bf46-474e-b730-d085dfd88ad9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:01.076667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 354/701] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:01.078379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9973c-2996-4406-b4c8-d5d79a71727f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:01.105850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101487e9-8e30-4fdb-a270-3d5e795ec190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:01.106611 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101487e9-8e30-4fdb-a270-3d5e795ec190 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.106894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101487e9-8e30-4fdb-a270-3d5e795ec190 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.107231 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101487e9-8e30-4fdb-a270-3d5e795ec190 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.108355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101487e9-8e30-4fdb-a270-3d5e795ec190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:01.108671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101487e9-8e30-4fdb-a270-3d5e795ec190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:01.110068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101487e9-8e30-4fdb-a270-3d5e795ec190 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:01.127303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 348/702] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:01.127303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101487e9-8e30-4fdb-a270-3d5e795ec190 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:01.211104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:01.215043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:01.227680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9973c-2996-4406-b4c8-d5d79a71727f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:01.238572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101487e9-8e30-4fdb-a270-3d5e795ec190 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:01.272952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cd228-06fa-4b7b-9365-0131c1bfb0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:01.274855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd228-06fa-4b7b-9365-0131c1bfb0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.275599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd228-06fa-4b7b-9365-0131c1bfb0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.276124 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd228-06fa-4b7b-9365-0131c1bfb0b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.279856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42be29-7433-4875-b277-52aafe34ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:01.280869 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42be29-7433-4875-b277-52aafe34ed40 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.281154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42be29-7433-4875-b277-52aafe34ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.281426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42be29-7433-4875-b277-52aafe34ed40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.286011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cd228-06fa-4b7b-9365-0131c1bfb0b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:01.287786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cd228-06fa-4b7b-9365-0131c1bfb0b3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:01.289423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42be29-7433-4875-b277-52aafe34ed40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:01.291275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42be29-7433-4875-b277-52aafe34ed40 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-180cd228-06fa-4b7b-9365-0131c1bfb0b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:01.304772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:01.305721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:01.306694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:01.306694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:01.306694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:01.306694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:01.306694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:01.306694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:01.306694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:01.306694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:01.313867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 355/703] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:01.313867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cd228-06fa-4b7b-9365-0131c1bfb0b3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6d42be29-7433-4875-b277-52aafe34ed40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:01.323706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:01.324653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:01.325547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:01.325547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:01.325547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:01.325547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:01.325547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:01.325547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:01.325547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:01.325547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:01.325547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 349/704] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:01.326374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42be29-7433-4875-b277-52aafe34ed40 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:01.437746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cd228-06fa-4b7b-9365-0131c1bfb0b3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:01.451955 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42be29-7433-4875-b277-52aafe34ed40 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:01.473321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cd35f-8e39-473b-a0c1-f49812cd6614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:01.474004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cd35f-8e39-473b-a0c1-f49812cd6614 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.474349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cd35f-8e39-473b-a0c1-f49812cd6614 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.474757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cd35f-8e39-473b-a0c1-f49812cd6614 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.475538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cd35f-8e39-473b-a0c1-f49812cd6614 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:01.477106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cd35f-8e39-473b-a0c1-f49812cd6614 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:01.496223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d07e7-1846-47be-85c0-cda8b40cff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:01.497219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d07e7-1846-47be-85c0-cda8b40cff22 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.497683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d07e7-1846-47be-85c0-cda8b40cff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.498352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d07e7-1846-47be-85c0-cda8b40cff22 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.499401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d07e7-1846-47be-85c0-cda8b40cff22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:01.499891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d07e7-1846-47be-85c0-cda8b40cff22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:01.508223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 356/705] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:16:01 2022] POST /identity/v3/users => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:01.508223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cd35f-8e39-473b-a0c1-f49812cd6614 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:01.510303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d07e7-1846-47be-85c0-cda8b40cff22 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:01.514276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:01.515941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:01.529645 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 350/706] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:01.538305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d07e7-1846-47be-85c0-cda8b40cff22 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:01.637650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cd35f-8e39-473b-a0c1-f49812cd6614 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:01.680258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022637cf-d6a5-4d8e-a0e6-92c5a538cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:01.681382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022637cf-d6a5-4d8e-a0e6-92c5a538cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.681673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022637cf-d6a5-4d8e-a0e6-92c5a538cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.681957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022637cf-d6a5-4d8e-a0e6-92c5a538cdf4 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.682772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022637cf-d6a5-4d8e-a0e6-92c5a538cdf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:01.683083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022637cf-d6a5-4d8e-a0e6-92c5a538cdf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:01.684967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022637cf-d6a5-4d8e-a0e6-92c5a538cdf4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:01.699932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 357/707] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:01.709251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022637cf-d6a5-4d8e-a0e6-92c5a538cdf4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:01.764957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d07e7-1846-47be-85c0-cda8b40cff22 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:01.808132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1d1cb-b553-4655-9928-e5dc314e8f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:01.808941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1d1cb-b553-4655-9928-e5dc314e8f12 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.809224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1d1cb-b553-4655-9928-e5dc314e8f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.809494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1d1cb-b553-4655-9928-e5dc314e8f12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.810374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1d1cb-b553-4655-9928-e5dc314e8f12 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=311b3c1e00d64423865b35a188ede79a) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:01.810688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1d1cb-b553-4655-9928-e5dc314e8f12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:01.812973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1d1cb-b553-4655-9928-e5dc314e8f12 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:01.820871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 351/708] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:01 2022] GET /identity/v3/role_assignments?user.id=311b3c1e00d64423865b35a188ede79a&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=9f557e97d94b4b499a6765419452e1ef => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:01.829244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:01.868363 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022637cf-d6a5-4d8e-a0e6-92c5a538cdf4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:01.911007 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41757e-cb27-461c-9add-9e8fab548e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:01.911687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313f33f-0d13-4e9e-b7a6-1e6703e8549d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.911800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41757e-cb27-461c-9add-9e8fab548e21 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.911997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41757e-cb27-461c-9add-9e8fab548e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.912318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41757e-cb27-461c-9add-9e8fab548e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.912668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313f33f-0d13-4e9e-b7a6-1e6703e8549d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.913142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313f33f-0d13-4e9e-b7a6-1e6703e8549d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.913271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41757e-cb27-461c-9add-9e8fab548e21 None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=7a79a7fbb30b45cd8677d84dd1b5c008) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:01.913468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41757e-cb27-461c-9add-9e8fab548e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:01.914931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41757e-cb27-461c-9add-9e8fab548e21 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:01.915546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 352/709] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:16:01.921680 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27474529-1463-4dc7-b5ac-7d6690f5cef4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:01.921998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27474529-1463-4dc7-b5ac-7d6690f5cef4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:01.922238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27474529-1463-4dc7-b5ac-7d6690f5cef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:01.923631 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 358/710] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:01 2022] GET /identity/v3/role_assignments?user.id=7a79a7fbb30b45cd8677d84dd1b5c008&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:01.954809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-27474529-1463-4dc7-b5ac-7d6690f5cef4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:01.956146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-27474529-1463-4dc7-b5ac-7d6690f5cef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:02.057204 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f041856-8070-4e1d-bf12-aea5ab01fec5 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:02.057391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f041856-8070-4e1d-bf12-aea5ab01fec5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:02.057664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f041856-8070-4e1d-bf12-aea5ab01fec5 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:02.059144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 359/711] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:02.067132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:02.067338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1627-d0ce-4ae0-8712-1d23d2e235f1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:02.067338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1627-d0ce-4ae0-8712-1d23d2e235f1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:02.067338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1627-d0ce-4ae0-8712-1d23d2e235f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:02.085342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 353/712] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:16:02.090282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c9ee1627-d0ce-4ae0-8712-1d23d2e235f1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:02.091858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c9ee1627-d0ce-4ae0-8712-1d23d2e235f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:02.109491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27474529-1463-4dc7-b5ac-7d6690f5cef4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:02.186266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 360/713] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 18:16:02.209823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee1627-d0ce-4ae0-8712-1d23d2e235f1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:02.250435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27474529-1463-4dc7-b5ac-7d6690f5cef4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:02.287034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:02.312576 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae8493-3719-4cef-bb41-6d7d3bd57554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:02.314341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8493-3719-4cef-bb41-6d7d3bd57554 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:02.314823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8493-3719-4cef-bb41-6d7d3bd57554 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:02.315322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8493-3719-4cef-bb41-6d7d3bd57554 None admin] PATH_INFO: `/v3/services/network` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:02.316991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae8493-3719-4cef-bb41-6d7d3bd57554 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:02.319142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae8493-3719-4cef-bb41-6d7d3bd57554 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:02.336482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee1627-d0ce-4ae0-8712-1d23d2e235f1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-06ae8493-3719-4cef-bb41-6d7d3bd57554 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:02.340091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:02.341217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 18:16:02.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:02.350586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 354/714] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:02 2022] GET /identity/v3/services/network => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:02.352177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae8493-3719-4cef-bb41-6d7d3bd57554 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:02.379557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c93b2a-c043-47ff-a69d-484668af34db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:02.380795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93b2a-c043-47ff-a69d-484668af34db None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:02.381323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93b2a-c043-47ff-a69d-484668af34db None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:02.381812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93b2a-c043-47ff-a69d-484668af34db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:02.382673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c93b2a-c043-47ff-a69d-484668af34db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:02.384278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c93b2a-c043-47ff-a69d-484668af34db None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-93c93b2a-c043-47ff-a69d-484668af34db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:02.399657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:02.400724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 18:16:02.401567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:02.404698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 361/715] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Jun 4 18:16:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:02.412524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:02.412696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c93b2a-c043-47ff-a69d-484668af34db None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:02.460462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae8493-3719-4cef-bb41-6d7d3bd57554 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:02.498649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804ed71-4893-42a9-9962-404fe2932a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:02.499606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ed71-4893-42a9-9962-404fe2932a10 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:02.500053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ed71-4893-42a9-9962-404fe2932a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:02.500466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ed71-4893-42a9-9962-404fe2932a10 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:02.501367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804ed71-4893-42a9-9962-404fe2932a10 None admin] RBAC: Adding query filter params (name=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:02.501812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804ed71-4893-42a9-9962-404fe2932a10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:02.503359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804ed71-4893-42a9-9962-404fe2932a10 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:02.508819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 355/716] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:02.514949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804ed71-4893-42a9-9962-404fe2932a10 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:02.536042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c93b2a-c043-47ff-a69d-484668af34db None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:02.564190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:02.573738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9da0-4574-43c2-b70b-fdda7dfd8e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:02.574676 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9da0-4574-43c2-b70b-fdda7dfd8e23 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:02.575151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9da0-4574-43c2-b70b-fdda7dfd8e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:02.575637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce9da0-4574-43c2-b70b-fdda7dfd8e23 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:02.576930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce9da0-4574-43c2-b70b-fdda7dfd8e23 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:02.577470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce9da0-4574-43c2-b70b-fdda7dfd8e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:02.579860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce9da0-4574-43c2-b70b-fdda7dfd8e23 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:02.589404 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 362/717] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 4 18:16:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:02.591077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9da0-4574-43c2-b70b-fdda7dfd8e23 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:02.619537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804ed71-4893-42a9-9962-404fe2932a10 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:02.637354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:02.656614 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a40b7e-cf42-4a44-ace5-b0bd0314b2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:02.657288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a40b7e-cf42-4a44-ace5-b0bd0314b2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:02.657576 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a40b7e-cf42-4a44-ace5-b0bd0314b2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:02.657847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a40b7e-cf42-4a44-ace5-b0bd0314b2a7 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:02.658651 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a40b7e-cf42-4a44-ace5-b0bd0314b2a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:02.658857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a40b7e-cf42-4a44-ace5-b0bd0314b2a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:02.660262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a40b7e-cf42-4a44-ace5-b0bd0314b2a7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:02.672054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 356/718] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:02.724563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce9da0-4574-43c2-b70b-fdda7dfd8e23 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:02.790788 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20de0dc-8451-4a87-92f5-8b60de98740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:02.791493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de0dc-8451-4a87-92f5-8b60de98740c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:02.791785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de0dc-8451-4a87-92f5-8b60de98740c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:02.792088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de0dc-8451-4a87-92f5-8b60de98740c None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:02.793178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20de0dc-8451-4a87-92f5-8b60de98740c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:02.793492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20de0dc-8451-4a87-92f5-8b60de98740c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:02.795763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20de0dc-8451-4a87-92f5-8b60de98740c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:02.805734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 363/719] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 4 18:16:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:04.318270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca54ca-ceaa-473e-8aa5-6e7a29904413 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:04.319209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca54ca-ceaa-473e-8aa5-6e7a29904413 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:04.319685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca54ca-ceaa-473e-8aa5-6e7a29904413 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:04.321543 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 357/720] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:04.332296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9158c-0cf5-4b98-92ca-5a25cbfc9541 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:04.333145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9158c-0cf5-4b98-92ca-5a25cbfc9541 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:04.333659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9158c-0cf5-4b98-92ca-5a25cbfc9541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:04.357001 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1fb9158c-0cf5-4b98-92ca-5a25cbfc9541 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:04.359165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1fb9158c-0cf5-4b98-92ca-5a25cbfc9541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:04.426638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:04.449529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4648786-cc73-4bdb-b653-a692f8ac38a3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:04.450066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 364/721] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:16:04.450427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4648786-cc73-4bdb-b653-a692f8ac38a3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:04.451088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4648786-cc73-4bdb-b653-a692f8ac38a3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:04.454461 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 358/722] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:04.459663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c396b0-d147-4015-8501-62e83767f72d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:04.459992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c396b0-d147-4015-8501-62e83767f72d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:04.460255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c396b0-d147-4015-8501-62e83767f72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:04.475940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4648786-cc73-4bdb-b653-a692f8ac38a3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:04.490841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d1c396b0-d147-4015-8501-62e83767f72d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:04.492058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d1c396b0-d147-4015-8501-62e83767f72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:04.630481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 365/723] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:16:04.660201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c396b0-d147-4015-8501-62e83767f72d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:04.679081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4648786-cc73-4bdb-b653-a692f8ac38a3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:04.737794 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4494d-271c-44fe-a11c-a5835d4fc16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:04.738611 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4494d-271c-44fe-a11c-a5835d4fc16b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:04.738897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4494d-271c-44fe-a11c-a5835d4fc16b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:04.739181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4494d-271c-44fe-a11c-a5835d4fc16b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:04.769084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4494d-271c-44fe-a11c-a5835d4fc16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-bab4494d-271c-44fe-a11c-a5835d4fc16b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:04.776780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:04.777697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:04.778852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 359/724] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:16:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:04.784147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4494d-271c-44fe-a11c-a5835d4fc16b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:04.829900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c396b0-d147-4015-8501-62e83767f72d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:04.869376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:04.877989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:04.908698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a0f7c-7638-4efb-9c83-6a8817958402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:04.909987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0f7c-7638-4efb-9c83-6a8817958402 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:04.910472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0f7c-7638-4efb-9c83-6a8817958402 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:04.910958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0f7c-7638-4efb-9c83-6a8817958402 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:04.935954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a0f7c-7638-4efb-9c83-6a8817958402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-251a0f7c-7638-4efb-9c83-6a8817958402 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:04.948423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:04.949433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:04.950252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:04.952834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 366/725] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:04.955076 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4494d-271c-44fe-a11c-a5835d4fc16b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:04.959571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a0f7c-7638-4efb-9c83-6a8817958402 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:05.024153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db23e8-caf9-490b-9985-bae5d3618126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:05.024847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db23e8-caf9-490b-9985-bae5d3618126 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.025132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db23e8-caf9-490b-9985-bae5d3618126 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.025406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db23e8-caf9-490b-9985-bae5d3618126 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.026303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db23e8-caf9-490b-9985-bae5d3618126 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:05.026619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db23e8-caf9-490b-9985-bae5d3618126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:05.028028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db23e8-caf9-490b-9985-bae5d3618126 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:05.038172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 360/726] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:16:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:05.043935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db23e8-caf9-490b-9985-bae5d3618126 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:05.090829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a0f7c-7638-4efb-9c83-6a8817958402 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:05.142357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458fc6c-aa7a-4410-89eb-c031b5b2fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:05.143427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458fc6c-aa7a-4410-89eb-c031b5b2fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.143933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458fc6c-aa7a-4410-89eb-c031b5b2fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.144439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458fc6c-aa7a-4410-89eb-c031b5b2fcf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.145393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458fc6c-aa7a-4410-89eb-c031b5b2fcf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:05.145904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458fc6c-aa7a-4410-89eb-c031b5b2fcf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:05.147707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458fc6c-aa7a-4410-89eb-c031b5b2fcf5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:05.157694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 367/727] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:16:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:05.164825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458fc6c-aa7a-4410-89eb-c031b5b2fcf5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:05.232954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db23e8-caf9-490b-9985-bae5d3618126 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:05.241212 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:05.241710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:05.287013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44badb4b-d9b5-4790-ba8c-5bf81519bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:05.287823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44badb4b-d9b5-4790-ba8c-5bf81519bc34 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.288166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44badb4b-d9b5-4790-ba8c-5bf81519bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.288444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44badb4b-d9b5-4790-ba8c-5bf81519bc34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.299654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44badb4b-d9b5-4790-ba8c-5bf81519bc34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:05.301192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44badb4b-d9b5-4790-ba8c-5bf81519bc34 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-44badb4b-d9b5-4790-ba8c-5bf81519bc34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:05.320315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:05.321701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:05.322560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:05.322560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:05.322560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:05.322560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:05.322560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 361/728] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:05.327814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6c65c-36d7-45b0-9560-bd077e697c7c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.328439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458fc6c-aa7a-4410-89eb-c031b5b2fcf5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:05.328681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6c65c-36d7-45b0-9560-bd077e697c7c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.329134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6c65c-36d7-45b0-9560-bd077e697c7c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.331083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 362/729] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:05.332115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6c65c-36d7-45b0-9560-bd077e697c7c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:05.370473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779b879-5f72-443c-a65d-eaf0d893f5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:05.371338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779b879-5f72-443c-a65d-eaf0d893f5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.371636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779b879-5f72-443c-a65d-eaf0d893f5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.371906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779b879-5f72-443c-a65d-eaf0d893f5f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.383930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779b879-5f72-443c-a65d-eaf0d893f5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:05.385531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779b879-5f72-443c-a65d-eaf0d893f5f0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-9779b879-5f72-443c-a65d-eaf0d893f5f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:05.404397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:05.405344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:05.406215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:05.406215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:05.406215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:05.406215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:05.410519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 368/730] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:05.411968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9562c1-6a4a-4455-bb25-e26e6daa14c6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.412314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9562c1-6a4a-4455-bb25-e26e6daa14c6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.412599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9562c1-6a4a-4455-bb25-e26e6daa14c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.430898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5e9562c1-6a4a-4455-bb25-e26e6daa14c6 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:05.432418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5e9562c1-6a4a-4455-bb25-e26e6daa14c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:05.446964 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6c65c-36d7-45b0-9560-bd077e697c7c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:05.492388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d26041-77c8-402e-9b85-606d9017c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:05.493555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d26041-77c8-402e-9b85-606d9017c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.494329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d26041-77c8-402e-9b85-606d9017c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.495037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d26041-77c8-402e-9b85-606d9017c4e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.495959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d26041-77c8-402e-9b85-606d9017c4e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:05.496601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d26041-77c8-402e-9b85-606d9017c4e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:05.498882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d26041-77c8-402e-9b85-606d9017c4e8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:05.516449 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 369/732] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:16:05.516449 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9562c1-6a4a-4455-bb25-e26e6daa14c6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:05.517037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 363/732] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:05.519212 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d26041-77c8-402e-9b85-606d9017c4e8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:05.536554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:05.538748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:05.622280 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9562c1-6a4a-4455-bb25-e26e6daa14c6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:05.633491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d26041-77c8-402e-9b85-606d9017c4e8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:05.658514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1e6f3-b466-41b6-8912-dd0e398c1c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:05.659544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1e6f3-b466-41b6-8912-dd0e398c1c32 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.659544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1e6f3-b466-41b6-8912-dd0e398c1c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.659780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1e6f3-b466-41b6-8912-dd0e398c1c32 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.660458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1e6f3-b466-41b6-8912-dd0e398c1c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:05.660762 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1e6f3-b466-41b6-8912-dd0e398c1c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:05.662243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1e6f3-b466-41b6-8912-dd0e398c1c32 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:05.674009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 370/733] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:05.675251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521181f-42f6-4dc7-9e17-2f0497c41572 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.675536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521181f-42f6-4dc7-9e17-2f0497c41572 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.675810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521181f-42f6-4dc7-9e17-2f0497c41572 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.676415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e4eb9-10e9-4d1b-bea4-27216a61eab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:05.680058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e4eb9-10e9-4d1b-bea4-27216a61eab8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.680194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 371/734] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:05.680276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e4eb9-10e9-4d1b-bea4-27216a61eab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.680276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e4eb9-10e9-4d1b-bea4-27216a61eab8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.680409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521181f-42f6-4dc7-9e17-2f0497c41572 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:05.688026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e4eb9-10e9-4d1b-bea4-27216a61eab8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:05.689449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e4eb9-10e9-4d1b-bea4-27216a61eab8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-454e4eb9-10e9-4d1b-bea4-27216a61eab8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:05.704283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:05.705244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:05.706147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 364/735] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 4 18:16:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:05.706824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f26ac2-f13f-4e00-ac39-a4ed6121ebe2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.707280 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f26ac2-f13f-4e00-ac39-a4ed6121ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.707280 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f26ac2-f13f-4e00-ac39-a4ed6121ebe2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.708746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 365/736] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:05.709432 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f26ac2-f13f-4e00-ac39-a4ed6121ebe2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:05.765009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:05.787585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:05.787748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521181f-42f6-4dc7-9e17-2f0497c41572 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:05.814337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f26ac2-f13f-4e00-ac39-a4ed6121ebe2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:05.822642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb020e8f-2d9f-430c-a2bb-00d89febcfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:05.823445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb020e8f-2d9f-430c-a2bb-00d89febcfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.823729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb020e8f-2d9f-430c-a2bb-00d89febcfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.824030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb020e8f-2d9f-430c-a2bb-00d89febcfc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.834711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb020e8f-2d9f-430c-a2bb-00d89febcfc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-cb020e8f-2d9f-430c-a2bb-00d89febcfc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:05.842848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:05.843832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:05.844875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 372/737] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:05.845665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408b328-c5c5-446c-a524-3c8751a31946 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.845937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408b328-c5c5-446c-a524-3c8751a31946 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.846212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3408b328-c5c5-446c-a524-3c8751a31946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.854932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3efa87-c872-4d97-aedc-b63c6646470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:05.855766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3efa87-c872-4d97-aedc-b63c6646470d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.856057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3efa87-c872-4d97-aedc-b63c6646470d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.856341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3efa87-c872-4d97-aedc-b63c6646470d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.862540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3408b328-c5c5-446c-a524-3c8751a31946 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:05.863741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3408b328-c5c5-446c-a524-3c8751a31946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:05.864267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3efa87-c872-4d97-aedc-b63c6646470d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:05.865733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3efa87-c872-4d97-aedc-b63c6646470d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1a3efa87-c872-4d97-aedc-b63c6646470d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:05.879981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:05.880918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 366/738] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 4 18:16:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:05.882099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3efa87-c872-4d97-aedc-b63c6646470d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:05.933675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 373/739] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:16:05.934957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88acd-3ec8-45e3-8e5b-5c86b0595334 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:05.935301 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88acd-3ec8-45e3-8e5b-5c86b0595334 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:05.935639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88acd-3ec8-45e3-8e5b-5c86b0595334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:05.957090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8fd88acd-3ec8-45e3-8e5b-5c86b0595334 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:05.958182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8fd88acd-3ec8-45e3-8e5b-5c86b0595334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:05.988981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3efa87-c872-4d97-aedc-b63c6646470d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:06.018217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:06.021944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0120a-a300-4d1c-9d93-98a10198fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:06.022678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0120a-a300-4d1c-9d93-98a10198fc6e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:06.022976 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0120a-a300-4d1c-9d93-98a10198fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:06.023253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0120a-a300-4d1c-9d93-98a10198fc6e None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:06.023886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 374/740] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 18:16:06.024120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0120a-a300-4d1c-9d93-98a10198fc6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:06.024435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0120a-a300-4d1c-9d93-98a10198fc6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:06.025251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88acd-3ec8-45e3-8e5b-5c86b0595334 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:06.025927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0120a-a300-4d1c-9d93-98a10198fc6e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:06.029142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:06.046698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 367/741] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 4 18:16:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:06.047492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0120a-a300-4d1c-9d93-98a10198fc6e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:06.125346 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88acd-3ec8-45e3-8e5b-5c86b0595334 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:06.148326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0120a-a300-4d1c-9d93-98a10198fc6e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:06.160294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6452-9eed-4132-9b6a-2f85f29addc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:06.160967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6452-9eed-4132-9b6a-2f85f29addc1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:06.161245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6452-9eed-4132-9b6a-2f85f29addc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:06.161496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6452-9eed-4132-9b6a-2f85f29addc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:06.162250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a6452-9eed-4132-9b6a-2f85f29addc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:06.162551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a6452-9eed-4132-9b6a-2f85f29addc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:06.163943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a6452-9eed-4132-9b6a-2f85f29addc1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:06.175399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 375/742] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:06.175945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6452-9eed-4132-9b6a-2f85f29addc1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:06.183865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25a71-4031-4a42-8e85-84c47d48c9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:06.184568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25a71-4031-4a42-8e85-84c47d48c9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:06.184877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25a71-4031-4a42-8e85-84c47d48c9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:06.185122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f25a71-4031-4a42-8e85-84c47d48c9e7 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:06.186260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f25a71-4031-4a42-8e85-84c47d48c9e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:06.186567 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f25a71-4031-4a42-8e85-84c47d48c9e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:06.188038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f25a71-4031-4a42-8e85-84c47d48c9e7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:06.205139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 368/743] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 4 18:16:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:06.205907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25a71-4031-4a42-8e85-84c47d48c9e7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:06.236597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:06.256203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:06.279026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6452-9eed-4132-9b6a-2f85f29addc1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:06.305334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f25a71-4031-4a42-8e85-84c47d48c9e7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:06.315993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b8c00-96ec-4523-9173-ce756a41b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:06.316683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b8c00-96ec-4523-9173-ce756a41b5ed None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:06.316965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b8c00-96ec-4523-9173-ce756a41b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:06.317240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b8c00-96ec-4523-9173-ce756a41b5ed None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:06.317966 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b8c00-96ec-4523-9173-ce756a41b5ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:06.319345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b8c00-96ec-4523-9173-ce756a41b5ed None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:06.335018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 376/744] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:16:06 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:06.335820 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b8c00-96ec-4523-9173-ce756a41b5ed None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:06.366779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27daf9ed-dd67-4dda-adc4-79ecfcccb72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:06.367462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daf9ed-dd67-4dda-adc4-79ecfcccb72c None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:06.367741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daf9ed-dd67-4dda-adc4-79ecfcccb72c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:06.368040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daf9ed-dd67-4dda-adc4-79ecfcccb72c None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:06.368792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27daf9ed-dd67-4dda-adc4-79ecfcccb72c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:06.370261 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27daf9ed-dd67-4dda-adc4-79ecfcccb72c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:06.387428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 369/745] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:16:06 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:06.388381 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27daf9ed-dd67-4dda-adc4-79ecfcccb72c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:06.491777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b8c00-96ec-4523-9173-ce756a41b5ed None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:06.518095 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:06.543007 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27daf9ed-dd67-4dda-adc4-79ecfcccb72c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:06.547127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:06.547837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616e376-ec4f-4b07-a0f2-14f0c98f3aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:06.548780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616e376-ec4f-4b07-a0f2-14f0c98f3aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:06.549281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616e376-ec4f-4b07-a0f2-14f0c98f3aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:06.549934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616e376-ec4f-4b07-a0f2-14f0c98f3aa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:06.593751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f990-56cb-460f-994f-1bd0a22f7d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:06.594588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f990-56cb-460f-994f-1bd0a22f7d80 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:06.594867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f990-56cb-460f-994f-1bd0a22f7d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:06.595139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f990-56cb-460f-994f-1bd0a22f7d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:06.606753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1f990-56cb-460f-994f-1bd0a22f7d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:06.608468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1f990-56cb-460f-994f-1bd0a22f7d80 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-42e1f990-56cb-460f-994f-1bd0a22f7d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:06.630494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:06.631451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:06.632367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:06.632367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:06.632367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:06.632367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:06.633639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 370/746] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:06.634561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f990-56cb-460f-994f-1bd0a22f7d80 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:06.645144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616e376-ec4f-4b07-a0f2-14f0c98f3aa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:06.646739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616e376-ec4f-4b07-a0f2-14f0c98f3aa1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:06.755832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f990-56cb-460f-994f-1bd0a22f7d80 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:06.786206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 377/747] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:16:06.787387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616e376-ec4f-4b07-a0f2-14f0c98f3aa1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:06.807495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:06.809431 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db884b-d642-4df9-b5e0-a93618ba01fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:06.811158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db884b-d642-4df9-b5e0-a93618ba01fe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:06.811448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db884b-d642-4df9-b5e0-a93618ba01fe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:06.811819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db884b-d642-4df9-b5e0-a93618ba01fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:06.828138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db884b-d642-4df9-b5e0-a93618ba01fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:06.830813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db884b-d642-4df9-b5e0-a93618ba01fe None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-89db884b-d642-4df9-b5e0-a93618ba01fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:06.854391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:06.855380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:06.856293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:06.856293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:06.856293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:06.856293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:06.856293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 371/748] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:06.857159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db884b-d642-4df9-b5e0-a93618ba01fe None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:06.871021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:06.923543 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616e376-ec4f-4b07-a0f2-14f0c98f3aa1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:06.967147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2724e-4ad6-4c6a-9455-b13574b4355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:06.967437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db884b-d642-4df9-b5e0-a93618ba01fe None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:06.967964 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2724e-4ad6-4c6a-9455-b13574b4355b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:06.968339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2724e-4ad6-4c6a-9455-b13574b4355b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:06.968929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2724e-4ad6-4c6a-9455-b13574b4355b None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:06.970656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2724e-4ad6-4c6a-9455-b13574b4355b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:06.971037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2724e-4ad6-4c6a-9455-b13574b4355b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:06.972564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2724e-4ad6-4c6a-9455-b13574b4355b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:06.992174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 378/749] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:06.993068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2724e-4ad6-4c6a-9455-b13574b4355b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.008672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c63f5d-4621-4b1f-8f40-8063a0512988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.009400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c63f5d-4621-4b1f-8f40-8063a0512988 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.009679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c63f5d-4621-4b1f-8f40-8063a0512988 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.009964 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c63f5d-4621-4b1f-8f40-8063a0512988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.022833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c63f5d-4621-4b1f-8f40-8063a0512988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.024492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c63f5d-4621-4b1f-8f40-8063a0512988 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-48c63f5d-4621-4b1f-8f40-8063a0512988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:07.043062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:07.044128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:07.045142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:07.045142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:07.045142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:07.045142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:07.045457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 372/750] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:07.046553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c63f5d-4621-4b1f-8f40-8063a0512988 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.078972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:07.110095 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2724e-4ad6-4c6a-9455-b13574b4355b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:07.132424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:07.145161 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d568672-1051-4de4-b2d6-627a04790aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.146094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d568672-1051-4de4-b2d6-627a04790aee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.146515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d568672-1051-4de4-b2d6-627a04790aee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.146934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d568672-1051-4de4-b2d6-627a04790aee None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.147801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d568672-1051-4de4-b2d6-627a04790aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:07.148277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d568672-1051-4de4-b2d6-627a04790aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.149830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d568672-1051-4de4-b2d6-627a04790aee None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.159007 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c63f5d-4621-4b1f-8f40-8063a0512988 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:07.163637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 379/751] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:07.164722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d568672-1051-4de4-b2d6-627a04790aee None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.200776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9e1f9-e762-423c-b987-eb416a437673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.202687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9e1f9-e762-423c-b987-eb416a437673 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.202687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9e1f9-e762-423c-b987-eb416a437673 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.202687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9e1f9-e762-423c-b987-eb416a437673 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.210447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9e1f9-e762-423c-b987-eb416a437673 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.212135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9e1f9-e762-423c-b987-eb416a437673 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-20e9e1f9-e762-423c-b987-eb416a437673 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:07.227265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:07.228469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:07.229648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:07.229648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:07.229648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:07.229648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:07.229648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:07.229648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:07.229648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:07.229648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:07.229648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:16:07.229648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:07.231055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 373/752] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:07.232274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9e1f9-e762-423c-b987-eb416a437673 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.274209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d568672-1051-4de4-b2d6-627a04790aee None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:07.311692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b22469-c40f-4e14-abc9-a9c09317172a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.312614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22469-c40f-4e14-abc9-a9c09317172a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.313040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22469-c40f-4e14-abc9-a9c09317172a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.313458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22469-c40f-4e14-abc9-a9c09317172a None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.314351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22469-c40f-4e14-abc9-a9c09317172a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:07.314798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22469-c40f-4e14-abc9-a9c09317172a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.316367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22469-c40f-4e14-abc9-a9c09317172a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.318992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:07.330274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 380/753] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:07.331420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b22469-c40f-4e14-abc9-a9c09317172a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.343388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9e1f9-e762-423c-b987-eb416a437673 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:07.365462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:07.381187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882f97f-6142-4b14-a711-4731a4a93e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.382667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882f97f-6142-4b14-a711-4731a4a93e2f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.383183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882f97f-6142-4b14-a711-4731a4a93e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.383765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882f97f-6142-4b14-a711-4731a4a93e2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.391324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882f97f-6142-4b14-a711-4731a4a93e2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.393007 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882f97f-6142-4b14-a711-4731a4a93e2f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c882f97f-6142-4b14-a711-4731a4a93e2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:07.408306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:07.409187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:07.410037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:07.410037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:07.410037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:07.410037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:07.410037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:07.410037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:07.410037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:07.410037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:07.416824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 374/754] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:07.418301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882f97f-6142-4b14-a711-4731a4a93e2f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.436570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b22469-c40f-4e14-abc9-a9c09317172a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:07.470759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd208d3-cdc6-422a-8160-286b939a043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.471530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd208d3-cdc6-422a-8160-286b939a043e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.471878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd208d3-cdc6-422a-8160-286b939a043e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.472287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd208d3-cdc6-422a-8160-286b939a043e None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.473231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd208d3-cdc6-422a-8160-286b939a043e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:07.473710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd208d3-cdc6-422a-8160-286b939a043e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.475111 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd208d3-cdc6-422a-8160-286b939a043e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.494293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 381/755] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 4 18:16:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:07.495269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd208d3-cdc6-422a-8160-286b939a043e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.527833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882f97f-6142-4b14-a711-4731a4a93e2f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:07.553397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:07.571043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683fd59-550d-41a0-ad06-7108175a4844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.572248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683fd59-550d-41a0-ad06-7108175a4844 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.572725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683fd59-550d-41a0-ad06-7108175a4844 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.573216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683fd59-550d-41a0-ad06-7108175a4844 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.580948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683fd59-550d-41a0-ad06-7108175a4844 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.582839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683fd59-550d-41a0-ad06-7108175a4844 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0683fd59-550d-41a0-ad06-7108175a4844 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:07.597630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:07.598538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:07.599411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:07.599411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:07.599411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:07.599411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:07.599411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:07.599411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:07.599411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:07.599411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:07.601640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd208d3-cdc6-422a-8160-286b939a043e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:07.602149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 375/756] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:07.603358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683fd59-550d-41a0-ad06-7108175a4844 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.637181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dafd7-03ee-4787-897a-6600eb327c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.637880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dafd7-03ee-4787-897a-6600eb327c82 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.638165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dafd7-03ee-4787-897a-6600eb327c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.638500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dafd7-03ee-4787-897a-6600eb327c82 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.639456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dafd7-03ee-4787-897a-6600eb327c82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:07.639650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dafd7-03ee-4787-897a-6600eb327c82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.641259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dafd7-03ee-4787-897a-6600eb327c82 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.652373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:07.656059 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 382/757] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:07.656864 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dafd7-03ee-4787-897a-6600eb327c82 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.721625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683fd59-550d-41a0-ad06-7108175a4844 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:07.757801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18155288-afa0-418a-8e1c-9ccea7885c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.758606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18155288-afa0-418a-8e1c-9ccea7885c0f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.758982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18155288-afa0-418a-8e1c-9ccea7885c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.759440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18155288-afa0-418a-8e1c-9ccea7885c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.766467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dafd7-03ee-4787-897a-6600eb327c82 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:07.781405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:07.803953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ed63c-c71c-47ef-badb-c34a7f369267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.804794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ed63c-c71c-47ef-badb-c34a7f369267 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.805146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ed63c-c71c-47ef-badb-c34a7f369267 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.805489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ed63c-c71c-47ef-badb-c34a7f369267 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.806440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ed63c-c71c-47ef-badb-c34a7f369267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:07.806821 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ed63c-c71c-47ef-badb-c34a7f369267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.808480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ed63c-c71c-47ef-badb-c34a7f369267 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.822197 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 383/758] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:07.823083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ed63c-c71c-47ef-badb-c34a7f369267 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.834595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18155288-afa0-418a-8e1c-9ccea7885c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.836262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18155288-afa0-418a-8e1c-9ccea7885c0f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.878570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:07.929224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ed63c-c71c-47ef-badb-c34a7f369267 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:07.940894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 376/759] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:16:07.941886 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18155288-afa0-418a-8e1c-9ccea7885c0f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:07.964999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b88f9a-3d9d-44c9-8d82-da07a409882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:07.965906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88f9a-3d9d-44c9-8d82-da07a409882f None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:07.966188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88f9a-3d9d-44c9-8d82-da07a409882f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:07.966522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88f9a-3d9d-44c9-8d82-da07a409882f None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/311b3c1e00d64423865b35a188ede79a/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:07.968909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b88f9a-3d9d-44c9-8d82-da07a409882f None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=311b3c1e00d64423865b35a188ede79a, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:07.970462 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b88f9a-3d9d-44c9-8d82-da07a409882f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:07.988333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 384/760] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:16:07 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/311b3c1e00d64423865b35a188ede79a/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:16:07.989170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b88f9a-3d9d-44c9-8d82-da07a409882f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:08.064560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:08.120418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18155288-afa0-418a-8e1c-9ccea7885c0f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:08.158602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c0957-82de-44a1-929a-844a15281fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:08.159280 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c0957-82de-44a1-929a-844a15281fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:08.159563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c0957-82de-44a1-929a-844a15281fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:08.159838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c0957-82de-44a1-929a-844a15281fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:08.160721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c0957-82de-44a1-929a-844a15281fd5 None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=733086955e19437e845f4f77c1178116) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:08.161035 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c0957-82de-44a1-929a-844a15281fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:08.162717 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c0957-82de-44a1-929a-844a15281fd5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:08.163969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b88f9a-3d9d-44c9-8d82-da07a409882f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:08.169958 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 377/761] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:07 2022] GET /identity/v3/role_assignments?user.id=733086955e19437e845f4f77c1178116&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:08.205715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad384f-00ae-4ce8-bd66-ce98e8e11d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:08.206551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad384f-00ae-4ce8-bd66-ce98e8e11d01 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:08.206836 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad384f-00ae-4ce8-bd66-ce98e8e11d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:08.207101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad384f-00ae-4ce8-bd66-ce98e8e11d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:08.219874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad384f-00ae-4ce8-bd66-ce98e8e11d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:08.221426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad384f-00ae-4ce8-bd66-ce98e8e11d01 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-48ad384f-00ae-4ce8-bd66-ce98e8e11d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:08.242757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:08.244906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:08.246965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:08.246965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:08.246965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:08.246965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:08.246965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 385/762] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:08.252050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c0957-82de-44a1-929a-844a15281fd5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:08.255008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:08.376491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c0957-82de-44a1-929a-844a15281fd5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:08.413371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5bb54-4b3e-4843-aa82-9945e35a852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:08.414165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5bb54-4b3e-4843-aa82-9945e35a852c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:08.414325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5bb54-4b3e-4843-aa82-9945e35a852c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:08.414603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5bb54-4b3e-4843-aa82-9945e35a852c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:08.415342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5bb54-4b3e-4843-aa82-9945e35a852c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:08.415647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5bb54-4b3e-4843-aa82-9945e35a852c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:08.417096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5bb54-4b3e-4843-aa82-9945e35a852c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:08.431325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 378/763] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:08.439089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad384f-00ae-4ce8-bd66-ce98e8e11d01 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:08.568412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:08.581440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad384f-00ae-4ce8-bd66-ce98e8e11d01 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:08.625978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f415095-ba5c-442d-b766-5058bc24ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:08.626852 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f415095-ba5c-442d-b766-5058bc24ef89 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:08.627074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f415095-ba5c-442d-b766-5058bc24ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:08.627347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f415095-ba5c-442d-b766-5058bc24ef89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:08.634623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f415095-ba5c-442d-b766-5058bc24ef89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:08.636110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f415095-ba5c-442d-b766-5058bc24ef89 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-9f415095-ba5c-442d-b766-5058bc24ef89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:08.656618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:08.658618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:08.660704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:08.660704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:08.660704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:08.660704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:08.660704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:08.660704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:08.660704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:08.660704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:08.664034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 386/764] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:08.664219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5bb54-4b3e-4843-aa82-9945e35a852c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:08.752750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:08.807854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5bb54-4b3e-4843-aa82-9945e35a852c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:08.842988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d05ce-94dd-41c0-9058-0bc39ec7c1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:08.843661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d05ce-94dd-41c0-9058-0bc39ec7c1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:08.843945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d05ce-94dd-41c0-9058-0bc39ec7c1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:08.844255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d05ce-94dd-41c0-9058-0bc39ec7c1b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:08.845050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d05ce-94dd-41c0-9058-0bc39ec7c1b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:08.845365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d05ce-94dd-41c0-9058-0bc39ec7c1b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:08.846827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d05ce-94dd-41c0-9058-0bc39ec7c1b4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:08.859274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 379/765] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:08.865153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f415095-ba5c-442d-b766-5058bc24ef89 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:08.912286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c673aa-c464-46fd-9cf5-e0d8eb6d705e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:08.912579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c673aa-c464-46fd-9cf5-e0d8eb6d705e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:08.912751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c673aa-c464-46fd-9cf5-e0d8eb6d705e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:08.914532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 380/766] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:16:08.919751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7604-6d59-4434-9b60-158106aec85f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:08.920073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7604-6d59-4434-9b60-158106aec85f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:08.920366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b7604-6d59-4434-9b60-158106aec85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:08.943137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d83b7604-6d59-4434-9b60-158106aec85f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:08.945043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d83b7604-6d59-4434-9b60-158106aec85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:08.989998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f415095-ba5c-442d-b766-5058bc24ef89 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:09.028628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5950e43-c5a7-4a5e-9d89-2c86a99d2a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:09.029599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950e43-c5a7-4a5e-9d89-2c86a99d2a40 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:09.029884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950e43-c5a7-4a5e-9d89-2c86a99d2a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:09.030159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5950e43-c5a7-4a5e-9d89-2c86a99d2a40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:09.030997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950e43-c5a7-4a5e-9d89-2c86a99d2a40 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=7a79a7fbb30b45cd8677d84dd1b5c008) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:09.031419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950e43-c5a7-4a5e-9d89-2c86a99d2a40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:09.032983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5950e43-c5a7-4a5e-9d89-2c86a99d2a40 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:09.037846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 381/767] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:09.039158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 387/768] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:08 2022] GET /identity/v3/role_assignments?user.id=7a79a7fbb30b45cd8677d84dd1b5c008&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=9f557e97d94b4b499a6765419452e1ef => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:09.039379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49eee3-47d0-4d7b-a240-c68b2978367d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:09.039570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49eee3-47d0-4d7b-a240-c68b2978367d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:09.039853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49eee3-47d0-4d7b-a240-c68b2978367d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:09.048522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 382/769] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:09.054707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47bc7e-c11d-406c-afd5-a0509515fdb7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:09.055025 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47bc7e-c11d-406c-afd5-a0509515fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:09.055252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47bc7e-c11d-406c-afd5-a0509515fdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:09.070906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49eee3-47d0-4d7b-a240-c68b2978367d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:09.083021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5e47bc7e-c11d-406c-afd5-a0509515fdb7 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:09.084669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5e47bc7e-c11d-406c-afd5-a0509515fdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:09.093378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:09.189205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 388/770] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:09.190944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:09.220419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47bc7e-c11d-406c-afd5-a0509515fdb7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:09.250013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49eee3-47d0-4d7b-a240-c68b2978367d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:09.316999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fa045-4517-4eba-9bbc-fd3162d3caa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:09.317947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fa045-4517-4eba-9bbc-fd3162d3caa3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:09.318157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fa045-4517-4eba-9bbc-fd3162d3caa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:09.318487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fa045-4517-4eba-9bbc-fd3162d3caa3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:09.319157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fa045-4517-4eba-9bbc-fd3162d3caa3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:09.321760 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fa045-4517-4eba-9bbc-fd3162d3caa3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0d3fa045-4517-4eba-9bbc-fd3162d3caa3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:09.335822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:09.336808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:09.337640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 383/771] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Jun 4 18:16:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:09.343438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fa045-4517-4eba-9bbc-fd3162d3caa3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:09.376216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47bc7e-c11d-406c-afd5-a0509515fdb7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:09.421821 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89783b6-3907-4a17-9d99-87625f85bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:09.423043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89783b6-3907-4a17-9d99-87625f85bbec None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:09.423555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89783b6-3907-4a17-9d99-87625f85bbec None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:09.424093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89783b6-3907-4a17-9d99-87625f85bbec None admin] PATH_INFO: `/v3/services/network` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:09.425069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89783b6-3907-4a17-9d99-87625f85bbec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:09.426852 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89783b6-3907-4a17-9d99-87625f85bbec None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b89783b6-3907-4a17-9d99-87625f85bbec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:09.440739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:09.441693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 18:16:09.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:09.445560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 389/772] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:09 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:09.456039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89783b6-3907-4a17-9d99-87625f85bbec None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:09.463984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:09.508574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fa045-4517-4eba-9bbc-fd3162d3caa3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:09.544158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:09.585461 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66b949-e195-4ece-b865-929c3b0279d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:09.586522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66b949-e195-4ece-b865-929c3b0279d3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:09.587092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66b949-e195-4ece-b865-929c3b0279d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:09.587568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66b949-e195-4ece-b865-929c3b0279d3 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:09.588578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66b949-e195-4ece-b865-929c3b0279d3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:09.589130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66b949-e195-4ece-b865-929c3b0279d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:09.590719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66b949-e195-4ece-b865-929c3b0279d3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:09.604754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 384/773] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 4 18:16:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:09.611287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66b949-e195-4ece-b865-929c3b0279d3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:09.647465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89783b6-3907-4a17-9d99-87625f85bbec None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:09.708467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805bbb2-8d86-446e-8aad-ca4432fecde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:09.709396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805bbb2-8d86-446e-8aad-ca4432fecde9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:09.709848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805bbb2-8d86-446e-8aad-ca4432fecde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:09.710399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805bbb2-8d86-446e-8aad-ca4432fecde9 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:09.711398 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805bbb2-8d86-446e-8aad-ca4432fecde9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:09.711851 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805bbb2-8d86-446e-8aad-ca4432fecde9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:09.713533 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805bbb2-8d86-446e-8aad-ca4432fecde9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:09.726599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 390/774] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:09.731957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805bbb2-8d86-446e-8aad-ca4432fecde9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:09.775824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66b949-e195-4ece-b865-929c3b0279d3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:09.808374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:09.839707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e74e7-8e56-4003-8911-779734309783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:09.840453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e74e7-8e56-4003-8911-779734309783 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:09.840732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e74e7-8e56-4003-8911-779734309783 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:09.841003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e74e7-8e56-4003-8911-779734309783 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:09.842620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e74e7-8e56-4003-8911-779734309783 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:09.842929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e74e7-8e56-4003-8911-779734309783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:09.844367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e74e7-8e56-4003-8911-779734309783 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:09.856488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 385/775] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 4 18:16:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:09.860763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e74e7-8e56-4003-8911-779734309783 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:09.871238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805bbb2-8d86-446e-8aad-ca4432fecde9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:09.932445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0455c-7aa3-4b6b-bf12-e41f35342d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:09.933118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0455c-7aa3-4b6b-bf12-e41f35342d34 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:09.933397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0455c-7aa3-4b6b-bf12-e41f35342d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:09.933667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0455c-7aa3-4b6b-bf12-e41f35342d34 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:09.934375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0455c-7aa3-4b6b-bf12-e41f35342d34 None admin] RBAC: Adding query filter params (type=network) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:09.934678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0455c-7aa3-4b6b-bf12-e41f35342d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:09.936139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0455c-7aa3-4b6b-bf12-e41f35342d34 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:09.945613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 391/776] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:09.952337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:09.952473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0455c-7aa3-4b6b-bf12-e41f35342d34 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:10.040618 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e74e7-8e56-4003-8911-779734309783 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:10.108495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e6d43-9327-4c03-83fd-24c8d55fcd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:10.109586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e6d43-9327-4c03-83fd-24c8d55fcd13 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:10.110072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e6d43-9327-4c03-83fd-24c8d55fcd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:10.110547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e6d43-9327-4c03-83fd-24c8d55fcd13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:10.111550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e6d43-9327-4c03-83fd-24c8d55fcd13 None admin] RBAC: Adding query filter params (interface=public, service_id=dbae1ffb8d7f45d58ac25adbefeee26e, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:10.112104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e6d43-9327-4c03-83fd-24c8d55fcd13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:10.113704 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e6d43-9327-4c03-83fd-24c8d55fcd13 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:10.133604 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0455c-7aa3-4b6b-bf12-e41f35342d34 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:10.138388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 386/777] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 4 18:16:09 2022] GET /identity/v3/endpoints?service_id=dbae1ffb8d7f45d58ac25adbefeee26e&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:10.145418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e6d43-9327-4c03-83fd-24c8d55fcd13 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:10.192180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:10.199994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a20ab4-6fc1-4d9c-84f7-be36adc761a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:10.201618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a20ab4-6fc1-4d9c-84f7-be36adc761a5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:10.202245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a20ab4-6fc1-4d9c-84f7-be36adc761a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:10.203686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a20ab4-6fc1-4d9c-84f7-be36adc761a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:10.204884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a20ab4-6fc1-4d9c-84f7-be36adc761a5 None admin] RBAC: Adding query filter params (interface=public, service_id=41861e25940d4d12a767eab971090465, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:10.206251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a20ab4-6fc1-4d9c-84f7-be36adc761a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:10.208504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a20ab4-6fc1-4d9c-84f7-be36adc761a5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:10.222587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 392/778] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 4 18:16:09 2022] GET /identity/v3/endpoints?service_id=41861e25940d4d12a767eab971090465&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:10.227971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a20ab4-6fc1-4d9c-84f7-be36adc761a5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:10.329495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e6d43-9327-4c03-83fd-24c8d55fcd13 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:10.341966 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a20ab4-6fc1-4d9c-84f7-be36adc761a5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:10.349307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:10.380173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9e86b-286f-48f0-b87b-84655b53b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:10.381176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9e86b-286f-48f0-b87b-84655b53b437 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:10.381781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9e86b-286f-48f0-b87b-84655b53b437 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:10.382240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9e86b-286f-48f0-b87b-84655b53b437 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:10.383118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9e86b-286f-48f0-b87b-84655b53b437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:10.384837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9e86b-286f-48f0-b87b-84655b53b437 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:10.390932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 393/779] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 4 18:16:10 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:10.400967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88c455-3716-4956-a582-d447008f0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:10.401987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88c455-3716-4956-a582-d447008f0840 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:10.402451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88c455-3716-4956-a582-d447008f0840 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:10.402906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88c455-3716-4956-a582-d447008f0840 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:10.403797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88c455-3716-4956-a582-d447008f0840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:10.406040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88c455-3716-4956-a582-d447008f0840 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:10.412610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 387/780] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 4 18:16:10 2022] GET /identity/v3/services => generated 772 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:10.806901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413205-ff6a-4bae-9e61-4afb14fd7b9b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:10.807422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413205-ff6a-4bae-9e61-4afb14fd7b9b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:10.807422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413205-ff6a-4bae-9e61-4afb14fd7b9b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:10.809097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 394/781] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:10.815476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894371-f7b2-45d5-be53-ba4d756358d1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:10.815920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894371-f7b2-45d5-be53-ba4d756358d1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:10.816150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894371-f7b2-45d5-be53-ba4d756358d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:10.833853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-65894371-f7b2-45d5-be53-ba4d756358d1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:10.835401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-65894371-f7b2-45d5-be53-ba4d756358d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:10.889555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cae45-4197-49e5-8eaa-a0372e8cc123 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:10.889905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cae45-4197-49e5-8eaa-a0372e8cc123 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:10.890118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cae45-4197-49e5-8eaa-a0372e8cc123 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:10.891794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 395/782] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:10.897484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f5267-3b3c-4020-9bfa-2648ce2fd5a0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:10.897761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f5267-3b3c-4020-9bfa-2648ce2fd5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:10.898050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f5267-3b3c-4020-9bfa-2648ce2fd5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:10.915328 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 388/783] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:10.921067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-215f5267-3b3c-4020-9bfa-2648ce2fd5a0 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:10.922264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-215f5267-3b3c-4020-9bfa-2648ce2fd5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:10.945330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65894371-f7b2-45d5-be53-ba4d756358d1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:11.020493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:11.037850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 396/784] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:11.066635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f5267-3b3c-4020-9bfa-2648ce2fd5a0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:11.112116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65894371-f7b2-45d5-be53-ba4d756358d1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:11.116700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:11.164406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273240d-ceb6-411e-99fa-43c711484229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:11.165320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273240d-ceb6-411e-99fa-43c711484229 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:11.165713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273240d-ceb6-411e-99fa-43c711484229 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:11.166085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273240d-ceb6-411e-99fa-43c711484229 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:11.175468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f5267-3b3c-4020-9bfa-2648ce2fd5a0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:11.189953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273240d-ceb6-411e-99fa-43c711484229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f273240d-ceb6-411e-99fa-43c711484229 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:11.197912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:11.198828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:11.199641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:11.208632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 389/785] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:11.210787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ed7d9-40c7-434f-8cd7-3afdf8309cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:11.211673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ed7d9-40c7-434f-8cd7-3afdf8309cde None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:11.212043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ed7d9-40c7-434f-8cd7-3afdf8309cde None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:11.212391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ed7d9-40c7-434f-8cd7-3afdf8309cde None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:11.215464 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273240d-ceb6-411e-99fa-43c711484229 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:11.224254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ed7d9-40c7-434f-8cd7-3afdf8309cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c61ed7d9-40c7-434f-8cd7-3afdf8309cde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:11.236979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:11.237950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:11.238781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 397/786] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:16:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:11.242604 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ed7d9-40c7-434f-8cd7-3afdf8309cde None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:11.331920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:11.396641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273240d-ceb6-411e-99fa-43c711484229 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:11.424361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ed7d9-40c7-434f-8cd7-3afdf8309cde None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:11.471179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d11fe-aaed-4dcd-aaca-cdecbee14649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:11.471866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d11fe-aaed-4dcd-aaca-cdecbee14649 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:11.472182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d11fe-aaed-4dcd-aaca-cdecbee14649 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:11.472459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d11fe-aaed-4dcd-aaca-cdecbee14649 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:11.473223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d11fe-aaed-4dcd-aaca-cdecbee14649 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:11.473529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d11fe-aaed-4dcd-aaca-cdecbee14649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:11.474914 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d11fe-aaed-4dcd-aaca-cdecbee14649 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:11.487932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676a0c-60aa-4452-85d7-7499ae0e786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:11.488645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676a0c-60aa-4452-85d7-7499ae0e786c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:11.488925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676a0c-60aa-4452-85d7-7499ae0e786c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:11.489200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676a0c-60aa-4452-85d7-7499ae0e786c None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:11.489958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5676a0c-60aa-4452-85d7-7499ae0e786c None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:11.490263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5676a0c-60aa-4452-85d7-7499ae0e786c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:11.491650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5676a0c-60aa-4452-85d7-7499ae0e786c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:11.497600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 390/787] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:16:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:11.504052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d11fe-aaed-4dcd-aaca-cdecbee14649 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:11.509915 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 398/788] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:16:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:11.516947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676a0c-60aa-4452-85d7-7499ae0e786c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:11.563892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:11.689386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676a0c-60aa-4452-85d7-7499ae0e786c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:11.703691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:11.706723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d11fe-aaed-4dcd-aaca-cdecbee14649 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:11.726281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30d61f-fac9-4ce0-aa4d-75894269cd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:11.727122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30d61f-fac9-4ce0-aa4d-75894269cd4e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:11.727403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30d61f-fac9-4ce0-aa4d-75894269cd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:11.727680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30d61f-fac9-4ce0-aa4d-75894269cd4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:11.739273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30d61f-fac9-4ce0-aa4d-75894269cd4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:11.740923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30d61f-fac9-4ce0-aa4d-75894269cd4e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-0b30d61f-fac9-4ce0-aa4d-75894269cd4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:11.759927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:11.761008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:11.761924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:11.761924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:11.761924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:11.761924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:11.761924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 399/789] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:11.769104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30d61f-fac9-4ce0-aa4d-75894269cd4e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:11.778386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2aeb6-4732-4ca0-b245-159b1cdadba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:11.784827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2aeb6-4732-4ca0-b245-159b1cdadba3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:11.785304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2aeb6-4732-4ca0-b245-159b1cdadba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:11.785752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2aeb6-4732-4ca0-b245-159b1cdadba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:11.804307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2aeb6-4732-4ca0-b245-159b1cdadba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:11.807146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2aeb6-4732-4ca0-b245-159b1cdadba3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-28a2aeb6-4732-4ca0-b245-159b1cdadba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:11.838100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:11.839481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:11.840400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:11.840400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:11.840400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:11.840400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:11.842970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 391/790] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:11.848583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2aeb6-4732-4ca0-b245-159b1cdadba3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:11.952676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:11.963140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30d61f-fac9-4ce0-aa4d-75894269cd4e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:11.979106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2aeb6-4732-4ca0-b245-159b1cdadba3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:12.005320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441955c-59b4-403d-ae9f-e16a8a5dc79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:12.006715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441955c-59b4-403d-ae9f-e16a8a5dc79c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.007435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441955c-59b4-403d-ae9f-e16a8a5dc79c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.007884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441955c-59b4-403d-ae9f-e16a8a5dc79c None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.008980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441955c-59b4-403d-ae9f-e16a8a5dc79c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:12.009737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441955c-59b4-403d-ae9f-e16a8a5dc79c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:12.011691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441955c-59b4-403d-ae9f-e16a8a5dc79c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:12.021981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45443b21-e8d4-4e46-97da-b760adc24120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:12.022747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443b21-e8d4-4e46-97da-b760adc24120 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.023099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443b21-e8d4-4e46-97da-b760adc24120 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.023875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443b21-e8d4-4e46-97da-b760adc24120 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.024844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45443b21-e8d4-4e46-97da-b760adc24120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:12.025367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45443b21-e8d4-4e46-97da-b760adc24120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:12.026850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45443b21-e8d4-4e46-97da-b760adc24120 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:12.027752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 400/791] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:12.029445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf9d34-d3a7-406c-a89a-9b2ef77a5cc9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.029894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf9d34-d3a7-406c-a89a-9b2ef77a5cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.030347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf9d34-d3a7-406c-a89a-9b2ef77a5cc9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.031967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 401/792] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:12.038166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf9d34-d3a7-406c-a89a-9b2ef77a5cc9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:12.049364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 392/793] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:12.050664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd76ea-ea47-4219-a2ed-9b1f9d803e32 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.050948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd76ea-ea47-4219-a2ed-9b1f9d803e32 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.051221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd76ea-ea47-4219-a2ed-9b1f9d803e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.072546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-82bd76ea-ea47-4219-a2ed-9b1f9d803e32 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:12.073720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-82bd76ea-ea47-4219-a2ed-9b1f9d803e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:12.087639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:12.149293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 393/794] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:12.149293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd76ea-ea47-4219-a2ed-9b1f9d803e32 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:12.180168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf9d34-d3a7-406c-a89a-9b2ef77a5cc9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:12.226689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:12.228333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba0d86-fcd6-462c-9b8f-1efbb1a47394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:12.229391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba0d86-fcd6-462c-9b8f-1efbb1a47394 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.230524 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba0d86-fcd6-462c-9b8f-1efbb1a47394 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.230524 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba0d86-fcd6-462c-9b8f-1efbb1a47394 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.240803 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba0d86-fcd6-462c-9b8f-1efbb1a47394 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:12.242279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba0d86-fcd6-462c-9b8f-1efbb1a47394 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-76ba0d86-fcd6-462c-9b8f-1efbb1a47394 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:12.257720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:12.258673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:12.259598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:12.259598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:12.259598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:12.259598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:12.259598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:12.259598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:12.259598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:12.259598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:12.259598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:12.259598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:12.263920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 402/795] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 4 18:16:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:12.264711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba0d86-fcd6-462c-9b8f-1efbb1a47394 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:12.269162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd76ea-ea47-4219-a2ed-9b1f9d803e32 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:12.310631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4218e-0160-437e-bb3b-5a39f1984dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:12.312556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4218e-0160-437e-bb3b-5a39f1984dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.313046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4218e-0160-437e-bb3b-5a39f1984dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.313515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4218e-0160-437e-bb3b-5a39f1984dc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.322870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4218e-0160-437e-bb3b-5a39f1984dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:12.325277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4218e-0160-437e-bb3b-5a39f1984dc8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3ce4218e-0160-437e-bb3b-5a39f1984dc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:12.343718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:12.344712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:12.345630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:12.345630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:12.345630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:12.345630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:12.345630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:12.345630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:12.345630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:12.345630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:12.345630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:16:12.345630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:12.348631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 394/796] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 4 18:16:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:12.349549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4218e-0160-437e-bb3b-5a39f1984dc8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:12.370090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:12.388305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba0d86-fcd6-462c-9b8f-1efbb1a47394 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:12.424812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b4d6c-d187-40ec-806d-ee36f4fac7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:12.425810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4d6c-d187-40ec-806d-ee36f4fac7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.426215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4d6c-d187-40ec-806d-ee36f4fac7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.426571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4d6c-d187-40ec-806d-ee36f4fac7a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.438147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b4d6c-d187-40ec-806d-ee36f4fac7a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-062b4d6c-d187-40ec-806d-ee36f4fac7a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:12.447453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:12.448628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:12.449664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:12.456664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 403/797] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:12.457697 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b4d6c-d187-40ec-806d-ee36f4fac7a2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:12.474657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4218e-0160-437e-bb3b-5a39f1984dc8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:12.509069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:12.518650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ab344-c592-4d0a-a2ac-ee3a3fdcef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:12.519586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab344-c592-4d0a-a2ac-ee3a3fdcef47 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.520095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab344-c592-4d0a-a2ac-ee3a3fdcef47 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.520526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ab344-c592-4d0a-a2ac-ee3a3fdcef47 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.521542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ab344-c592-4d0a-a2ac-ee3a3fdcef47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:12.521991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ab344-c592-4d0a-a2ac-ee3a3fdcef47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:12.523760 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ab344-c592-4d0a-a2ac-ee3a3fdcef47 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:12.544524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 395/798] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 4 18:16:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:12.545713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ab344-c592-4d0a-a2ac-ee3a3fdcef47 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:12.577542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b4d6c-d187-40ec-806d-ee36f4fac7a2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:12.613665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6be70-dc67-404d-9e93-ed2ff602ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:12.614504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6be70-dc67-404d-9e93-ed2ff602ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.614872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6be70-dc67-404d-9e93-ed2ff602ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.615244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6be70-dc67-404d-9e93-ed2ff602ecb5 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.616216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6be70-dc67-404d-9e93-ed2ff602ecb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:12.616939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6be70-dc67-404d-9e93-ed2ff602ecb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:12.618321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6be70-dc67-404d-9e93-ed2ff602ecb5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:12.642532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 404/799] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 4 18:16:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:12.643767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6be70-dc67-404d-9e93-ed2ff602ecb5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:12.647000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:12.656211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ab344-c592-4d0a-a2ac-ee3a3fdcef47 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:12.694117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3137870-d244-449c-8c52-a8fff60502ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:12.695085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3137870-d244-449c-8c52-a8fff60502ee None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.695513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3137870-d244-449c-8c52-a8fff60502ee None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.695997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3137870-d244-449c-8c52-a8fff60502ee None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.696981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3137870-d244-449c-8c52-a8fff60502ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:12.697493 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3137870-d244-449c-8c52-a8fff60502ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:12.699103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3137870-d244-449c-8c52-a8fff60502ee None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:12.708585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 396/800] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:12.709723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3137870-d244-449c-8c52-a8fff60502ee None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:12.759882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6be70-dc67-404d-9e93-ed2ff602ecb5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:12.761133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:12.802982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d4091-bc61-483b-8541-b4dc929551b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:12.804495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d4091-bc61-483b-8541-b4dc929551b8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.804994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d4091-bc61-483b-8541-b4dc929551b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.805988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d4091-bc61-483b-8541-b4dc929551b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.821834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d4091-bc61-483b-8541-b4dc929551b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:12.824472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d4091-bc61-483b-8541-b4dc929551b8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:12.829632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3137870-d244-449c-8c52-a8fff60502ee None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ad6d4091-bc61-483b-8541-b4dc929551b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:12.850226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:12.851174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:12.852061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:12.852061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:12.852061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:12.852061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:12.856112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 405/801] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:12.857171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d4091-bc61-483b-8541-b4dc929551b8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:12.871406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915f5f2-13a1-4db1-981f-004c686dfab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:12.872846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915f5f2-13a1-4db1-981f-004c686dfab3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:12.873329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915f5f2-13a1-4db1-981f-004c686dfab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:12.873815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915f5f2-13a1-4db1-981f-004c686dfab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:12.917168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:12.943876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915f5f2-13a1-4db1-981f-004c686dfab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:12.945709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915f5f2-13a1-4db1-981f-004c686dfab3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:12.966693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d4091-bc61-483b-8541-b4dc929551b8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:12.995729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:13.003384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048cf4-981b-43fa-86bc-035b5055a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:13.004228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048cf4-981b-43fa-86bc-035b5055a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.004509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048cf4-981b-43fa-86bc-035b5055a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.004924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96048cf4-981b-43fa-86bc-035b5055a7e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.016758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96048cf4-981b-43fa-86bc-035b5055a7e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:13.018188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96048cf4-981b-43fa-86bc-035b5055a7e1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-96048cf4-981b-43fa-86bc-035b5055a7e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:13.036406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:13.037300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:13.038167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:13.038167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:13.038167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:13.038167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:13.038167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 406/802] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:13.038850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048cf4-981b-43fa-86bc-035b5055a7e1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.056179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 397/803] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:16:13.057818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b116de-1ae6-4abf-9a48-12cd29336a60 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.058304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b116de-1ae6-4abf-9a48-12cd29336a60 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.058799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b116de-1ae6-4abf-9a48-12cd29336a60 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.064751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 398/804] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:13.065171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b116de-1ae6-4abf-9a48-12cd29336a60 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.152806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96048cf4-981b-43fa-86bc-035b5055a7e1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:13.160653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:13.170773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b116de-1ae6-4abf-9a48-12cd29336a60 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:13.189623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906725c6-10cb-45db-a652-a74b1b35b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:13.190286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906725c6-10cb-45db-a652-a74b1b35b55b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.190567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906725c6-10cb-45db-a652-a74b1b35b55b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.190838 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906725c6-10cb-45db-a652-a74b1b35b55b None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.191549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906725c6-10cb-45db-a652-a74b1b35b55b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:13.191887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906725c6-10cb-45db-a652-a74b1b35b55b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:13.193315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906725c6-10cb-45db-a652-a74b1b35b55b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:13.205161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81da1d-97d4-4356-b35a-79fef616c169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:13.205345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 407/805] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:13.205830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81da1d-97d4-4356-b35a-79fef616c169 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.206070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906725c6-10cb-45db-a652-a74b1b35b55b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.206189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81da1d-97d4-4356-b35a-79fef616c169 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.206439 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81da1d-97d4-4356-b35a-79fef616c169 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.207160 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81da1d-97d4-4356-b35a-79fef616c169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:13.207462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81da1d-97d4-4356-b35a-79fef616c169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:13.208853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81da1d-97d4-4356-b35a-79fef616c169 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:13.221179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 399/806] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:13.222541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988ceb-7caf-4c6b-94ca-826339013201 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.222837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988ceb-7caf-4c6b-94ca-826339013201 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.223116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988ceb-7caf-4c6b-94ca-826339013201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.240716 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dc988ceb-7caf-4c6b-94ca-826339013201 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:13.241930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dc988ceb-7caf-4c6b-94ca-826339013201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:13.243892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:13.305892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906725c6-10cb-45db-a652-a74b1b35b55b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:13.314971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 400/807] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:13.316409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e478d-315c-4e80-a233-50f8253d5885 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.316702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e478d-315c-4e80-a233-50f8253d5885 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.316980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e478d-315c-4e80-a233-50f8253d5885 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.318260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 401/808] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:13.318943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e478d-315c-4e80-a233-50f8253d5885 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.353166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cde06b-9dab-44a6-8b37-72b720d42393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:13.353973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cde06b-9dab-44a6-8b37-72b720d42393 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.354253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cde06b-9dab-44a6-8b37-72b720d42393 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.354523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cde06b-9dab-44a6-8b37-72b720d42393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.366174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cde06b-9dab-44a6-8b37-72b720d42393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:13.367659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cde06b-9dab-44a6-8b37-72b720d42393 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b6cde06b-9dab-44a6-8b37-72b720d42393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:13.384887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:13.385765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:13.386655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:13.386655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:13.386655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:13.386655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:13.386655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 408/809] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:13.386922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cde06b-9dab-44a6-8b37-72b720d42393 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.408272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:13.425247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e478d-315c-4e80-a233-50f8253d5885 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:13.458708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dcd71-d887-4e97-b991-f4d4a9b252a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:13.459496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcd71-d887-4e97-b991-f4d4a9b252a2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.459771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcd71-d887-4e97-b991-f4d4a9b252a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.460073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcd71-d887-4e97-b991-f4d4a9b252a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.466893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dcd71-d887-4e97-b991-f4d4a9b252a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:13.468427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dcd71-d887-4e97-b991-f4d4a9b252a2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:13.470313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c90dcd71-d887-4e97-b991-f4d4a9b252a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:13.483881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:13.485053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:13.486141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:13.486141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:13.486141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:13.486141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:13.486141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:13.486141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:13.486141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:13.486141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:13.486141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 402/810] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:13.489215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9a7fc-abad-44ee-b354-b128ae14c233 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.489541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9a7fc-abad-44ee-b354-b128ae14c233 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.489821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9a7fc-abad-44ee-b354-b128ae14c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.493419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cde06b-9dab-44a6-8b37-72b720d42393 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:13.506532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4fe9a7fc-abad-44ee-b354-b128ae14c233 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:13.507728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4fe9a7fc-abad-44ee-b354-b128ae14c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:13.526195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de09f35-3fcf-4869-9cdd-4c259780dbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:13.526997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09f35-3fcf-4869-9cdd-4c259780dbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.527273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09f35-3fcf-4869-9cdd-4c259780dbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.527545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de09f35-3fcf-4869-9cdd-4c259780dbd4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.535098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de09f35-3fcf-4869-9cdd-4c259780dbd4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:13.536625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de09f35-3fcf-4869-9cdd-4c259780dbd4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4de09f35-3fcf-4869-9cdd-4c259780dbd4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:13.556766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:13.557945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 409/811] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:13.559033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de09f35-3fcf-4869-9cdd-4c259780dbd4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.583074 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 403/812] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:13.583923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9a7fc-abad-44ee-b354-b128ae14c233 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.639383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:13.661061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de09f35-3fcf-4869-9cdd-4c259780dbd4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:13.685116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9a7fc-abad-44ee-b354-b128ae14c233 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:13.695326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc70fb-a31c-4a83-a892-0943598f49bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:13.696173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc70fb-a31c-4a83-a892-0943598f49bc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.696452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc70fb-a31c-4a83-a892-0943598f49bc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.696729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc70fb-a31c-4a83-a892-0943598f49bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.697377 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc70fb-a31c-4a83-a892-0943598f49bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:13.698829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc70fb-a31c-4a83-a892-0943598f49bc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:13.711190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-70dc70fb-a31c-4a83-a892-0943598f49bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:13.712217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:13.713286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 18:16:13.714098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:13.718620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 410/813] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:13.719431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc70fb-a31c-4a83-a892-0943598f49bc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.721053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7ca8b-8bce-4010-bf04-bcde19f21902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:13.721729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7ca8b-8bce-4010-bf04-bcde19f21902 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.722017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7ca8b-8bce-4010-bf04-bcde19f21902 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.722296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7ca8b-8bce-4010-bf04-bcde19f21902 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.723028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7ca8b-8bce-4010-bf04-bcde19f21902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:13.723344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7ca8b-8bce-4010-bf04-bcde19f21902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:13.724766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7ca8b-8bce-4010-bf04-bcde19f21902 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:13.737093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 404/814] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:13.737887 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7ca8b-8bce-4010-bf04-bcde19f21902 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.828153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc70fb-a31c-4a83-a892-0943598f49bc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:13.839161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7ca8b-8bce-4010-bf04-bcde19f21902 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:13.860816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3daf2d-e037-4b2c-a2fe-060fcb59cc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:13.861494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3daf2d-e037-4b2c-a2fe-060fcb59cc03 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.861778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3daf2d-e037-4b2c-a2fe-060fcb59cc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.862032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3daf2d-e037-4b2c-a2fe-060fcb59cc03 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.862823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3daf2d-e037-4b2c-a2fe-060fcb59cc03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:13.863137 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3daf2d-e037-4b2c-a2fe-060fcb59cc03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:13.864645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3daf2d-e037-4b2c-a2fe-060fcb59cc03 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:13.872396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94c4e3-dc44-4bb3-a1aa-47178e8f8af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:13.873096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94c4e3-dc44-4bb3-a1aa-47178e8f8af7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:13.873383 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94c4e3-dc44-4bb3-a1aa-47178e8f8af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:13.873679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94c4e3-dc44-4bb3-a1aa-47178e8f8af7 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:13.874497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94c4e3-dc44-4bb3-a1aa-47178e8f8af7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:13.874809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94c4e3-dc44-4bb3-a1aa-47178e8f8af7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:13.876262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94c4e3-dc44-4bb3-a1aa-47178e8f8af7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:13.876830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 411/815] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:13.877620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3daf2d-e037-4b2c-a2fe-060fcb59cc03 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.880161 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:13.898172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 405/816] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:13.898988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94c4e3-dc44-4bb3-a1aa-47178e8f8af7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:13.947786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:13.976394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3daf2d-e037-4b2c-a2fe-060fcb59cc03 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.001247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94c4e3-dc44-4bb3-a1aa-47178e8f8af7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.010583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ace3bf-c3b0-42bc-97b7-b73dd2ccdce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.011429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ace3bf-c3b0-42bc-97b7-b73dd2ccdce7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.011732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ace3bf-c3b0-42bc-97b7-b73dd2ccdce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.012036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ace3bf-c3b0-42bc-97b7-b73dd2ccdce7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.012773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ace3bf-c3b0-42bc-97b7-b73dd2ccdce7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.014487 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ace3bf-c3b0-42bc-97b7-b73dd2ccdce7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d4ace3bf-c3b0-42bc-97b7-b73dd2ccdce7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:14.025925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:14.026909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:14.027734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 412/817] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/services/network => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:14.028546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ace3bf-c3b0-42bc-97b7-b73dd2ccdce7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.040828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f45009-72ee-46bd-9b02-ce812f7a5acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.041527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f45009-72ee-46bd-9b02-ce812f7a5acc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.041811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f45009-72ee-46bd-9b02-ce812f7a5acc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.042088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f45009-72ee-46bd-9b02-ce812f7a5acc None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.043156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f45009-72ee-46bd-9b02-ce812f7a5acc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:14.043456 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f45009-72ee-46bd-9b02-ce812f7a5acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.044958 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f45009-72ee-46bd-9b02-ce812f7a5acc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.049493 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 406/818] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 4 18:16:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:14.050235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f45009-72ee-46bd-9b02-ce812f7a5acc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.092888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:14.127440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ace3bf-c3b0-42bc-97b7-b73dd2ccdce7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.146349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f45009-72ee-46bd-9b02-ce812f7a5acc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.157164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:14.161077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8d1ac-6fa9-47d2-b641-4d41b6f463ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.161893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8d1ac-6fa9-47d2-b641-4d41b6f463ec None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.162178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8d1ac-6fa9-47d2-b641-4d41b6f463ec None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.162467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8d1ac-6fa9-47d2-b641-4d41b6f463ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.169677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8d1ac-6fa9-47d2-b641-4d41b6f463ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.171154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8d1ac-6fa9-47d2-b641-4d41b6f463ec None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.181486 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac9188-f559-47d2-93ed-3698b4d75adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.182385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac9188-f559-47d2-93ed-3698b4d75adf None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.182670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac9188-f559-47d2-93ed-3698b4d75adf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.182943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac9188-f559-47d2-93ed-3698b4d75adf None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/733086955e19437e845f4f77c1178116/roles/85ff050dde264c0fbb4e9e7efa4c1a34` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6fa8d1ac-6fa9-47d2-b641-4d41b6f463ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:14.185285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:14.186176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:14.187039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:14.187039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:14.187039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:14.187039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:14.187039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:14.187039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:14.187039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:14.187039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:14.187039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 413/819] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:14.187507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8d1ac-6fa9-47d2-b641-4d41b6f463ec None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.204907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac9188-f559-47d2-93ed-3698b4d75adf None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=733086955e19437e845f4f77c1178116, role_id=85ff050dde264c0fbb4e9e7efa4c1a34)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.206384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac9188-f559-47d2-93ed-3698b4d75adf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.232075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 407/820] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:16:14 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/733086955e19437e845f4f77c1178116/roles/85ff050dde264c0fbb4e9e7efa4c1a34 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:16:14.232075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac9188-f559-47d2-93ed-3698b4d75adf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.315832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8d1ac-6fa9-47d2-b641-4d41b6f463ec None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.342251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac9188-f559-47d2-93ed-3698b4d75adf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.348384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:14.359720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6b254-93d9-4e18-ac3c-8faffd5d2fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.360586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6b254-93d9-4e18-ac3c-8faffd5d2fae None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.360869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6b254-93d9-4e18-ac3c-8faffd5d2fae None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.361142 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6b254-93d9-4e18-ac3c-8faffd5d2fae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.372950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6b254-93d9-4e18-ac3c-8faffd5d2fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.374315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6b254-93d9-4e18-ac3c-8faffd5d2fae None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.381559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb2087-2345-4300-80c8-7c2ce185681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.382761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb2087-2345-4300-80c8-7c2ce185681b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.383055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb2087-2345-4300-80c8-7c2ce185681b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.383336 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb2087-2345-4300-80c8-7c2ce185681b None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.384509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb2087-2345-4300-80c8-7c2ce185681b None admin] RBAC: Adding query filter params (name=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:14.384833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb2087-2345-4300-80c8-7c2ce185681b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.386253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb2087-2345-4300-80c8-7c2ce185681b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.396269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 408/821] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:14.396269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb2087-2345-4300-80c8-7c2ce185681b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f1f6b254-93d9-4e18-ac3c-8faffd5d2fae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:14.396525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:14.397396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:14.398250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:14.398250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:14.398250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:14.398250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:14.398250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 414/822] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:14.398250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6b254-93d9-4e18-ac3c-8faffd5d2fae None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.427940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:14.508366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb2087-2345-4300-80c8-7c2ce185681b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.511888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6b254-93d9-4e18-ac3c-8faffd5d2fae None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.544121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f35e0-191d-459b-a809-f6559d2cc8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.546026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f35e0-191d-459b-a809-f6559d2cc8db None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.546656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f35e0-191d-459b-a809-f6559d2cc8db None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.546925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f35e0-191d-459b-a809-f6559d2cc8db None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.547632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f35e0-191d-459b-a809-f6559d2cc8db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:14.548052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f35e0-191d-459b-a809-f6559d2cc8db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.550012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f35e0-191d-459b-a809-f6559d2cc8db None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.551182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429cc4-b5fc-443e-a9a3-29de8b59e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.551859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429cc4-b5fc-443e-a9a3-29de8b59e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.552177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429cc4-b5fc-443e-a9a3-29de8b59e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.552463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429cc4-b5fc-443e-a9a3-29de8b59e9a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.553269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429cc4-b5fc-443e-a9a3-29de8b59e9a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:14.553583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429cc4-b5fc-443e-a9a3-29de8b59e9a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.555170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429cc4-b5fc-443e-a9a3-29de8b59e9a8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.561554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 409/823] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Jun 4 18:16:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:14.562466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f35e0-191d-459b-a809-f6559d2cc8db None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.572049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 415/824] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:14.572894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429cc4-b5fc-443e-a9a3-29de8b59e9a8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.639242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:14.661992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:14.675791 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f35e0-191d-459b-a809-f6559d2cc8db None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.705145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429cc4-b5fc-443e-a9a3-29de8b59e9a8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.712064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a783-5ae1-45a4-bb83-4d1df840e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.712744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a783-5ae1-45a4-bb83-4d1df840e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.713053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a783-5ae1-45a4-bb83-4d1df840e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.713377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a783-5ae1-45a4-bb83-4d1df840e8f2 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.714027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7a783-5ae1-45a4-bb83-4d1df840e8f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:14.714411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7a783-5ae1-45a4-bb83-4d1df840e8f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.715915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7a783-5ae1-45a4-bb83-4d1df840e8f2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.724102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 410/825] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:14.724102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a783-5ae1-45a4-bb83-4d1df840e8f2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.746856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94b8d-800d-4722-b0c1-849afe8ee603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.747607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94b8d-800d-4722-b0c1-849afe8ee603 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.747896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94b8d-800d-4722-b0c1-849afe8ee603 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.748209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94b8d-800d-4722-b0c1-849afe8ee603 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.748952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd94b8d-800d-4722-b0c1-849afe8ee603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:14.749263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd94b8d-800d-4722-b0c1-849afe8ee603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.750657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd94b8d-800d-4722-b0c1-849afe8ee603 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.766221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 416/826] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:14.767295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94b8d-800d-4722-b0c1-849afe8ee603 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.830879 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a783-5ae1-45a4-bb83-4d1df840e8f2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.864702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:14.867754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc684-66fb-49ee-9184-1b58b7b066ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.868448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc684-66fb-49ee-9184-1b58b7b066ac None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.868729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc684-66fb-49ee-9184-1b58b7b066ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.868996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc684-66fb-49ee-9184-1b58b7b066ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.869096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94b8d-800d-4722-b0c1-849afe8ee603 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:14.869729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc684-66fb-49ee-9184-1b58b7b066ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.871235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc684-66fb-49ee-9184-1b58b7b066ac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.902010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 411/827] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 4 18:16:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:14.902739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc684-66fb-49ee-9184-1b58b7b066ac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:14.923075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:14.926910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961f010-0840-47ed-aba7-7f2b5ea169d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:14.927992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961f010-0840-47ed-aba7-7f2b5ea169d3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:14.928588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961f010-0840-47ed-aba7-7f2b5ea169d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:14.929047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961f010-0840-47ed-aba7-7f2b5ea169d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:14.930028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961f010-0840-47ed-aba7-7f2b5ea169d3 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=311b3c1e00d64423865b35a188ede79a) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:14.930498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961f010-0840-47ed-aba7-7f2b5ea169d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:14.933175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961f010-0840-47ed-aba7-7f2b5ea169d3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:14.941422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 417/828] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:14 2022] GET /identity/v3/role_assignments?user.id=311b3c1e00d64423865b35a188ede79a&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=9f557e97d94b4b499a6765419452e1ef => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:14.942393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961f010-0840-47ed-aba7-7f2b5ea169d3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:15.069885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961f010-0840-47ed-aba7-7f2b5ea169d3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:15.114645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462d918-0b43-4590-ab84-17f1d7990d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:15.114645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462d918-0b43-4590-ab84-17f1d7990d26 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:15.114645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462d918-0b43-4590-ab84-17f1d7990d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:15.114645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462d918-0b43-4590-ab84-17f1d7990d26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:15.122867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462d918-0b43-4590-ab84-17f1d7990d26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:15.123403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc684-66fb-49ee-9184-1b58b7b066ac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:15.124432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462d918-0b43-4590-ab84-17f1d7990d26 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-9462d918-0b43-4590-ab84-17f1d7990d26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:15.149722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:15.150891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:15.152130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:15.152130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:15.152130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:15.152130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:15.152130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:15.152130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:15.152130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:15.152130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:15.156189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 418/829] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:15.164519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462d918-0b43-4590-ab84-17f1d7990d26 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:15.195418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106de41e-cc44-4cd2-bf3f-10add86a88d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:15.196436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de41e-cc44-4cd2-bf3f-10add86a88d8 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:15.197985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de41e-cc44-4cd2-bf3f-10add86a88d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:15.198419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de41e-cc44-4cd2-bf3f-10add86a88d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:15.199391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106de41e-cc44-4cd2-bf3f-10add86a88d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:15.202258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106de41e-cc44-4cd2-bf3f-10add86a88d8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:15.208714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:15.238666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 412/830] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 4 18:16:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:15.327735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462d918-0b43-4590-ab84-17f1d7990d26 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:15.376259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5805f3-3d58-4731-bf12-2778a36fabab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:15.376970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5805f3-3d58-4731-bf12-2778a36fabab None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:15.377292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5805f3-3d58-4731-bf12-2778a36fabab None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:15.377590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5805f3-3d58-4731-bf12-2778a36fabab None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:15.378401 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5805f3-3d58-4731-bf12-2778a36fabab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:15.378710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5805f3-3d58-4731-bf12-2778a36fabab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:15.380289 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5805f3-3d58-4731-bf12-2778a36fabab None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:15.399470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 419/831] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:15.400933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106de41e-cc44-4cd2-bf3f-10add86a88d8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:15.479058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:15.521123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106de41e-cc44-4cd2-bf3f-10add86a88d8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:15.557120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc4d6f-1d1b-4e7c-9fa9-ce981cabab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:15.558019 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc4d6f-1d1b-4e7c-9fa9-ce981cabab2d None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:15.558298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc4d6f-1d1b-4e7c-9fa9-ce981cabab2d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:15.558571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc4d6f-1d1b-4e7c-9fa9-ce981cabab2d None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/7a79a7fbb30b45cd8677d84dd1b5c008/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:15.561029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc4d6f-1d1b-4e7c-9fa9-ce981cabab2d None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=7a79a7fbb30b45cd8677d84dd1b5c008, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:15.562739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc4d6f-1d1b-4e7c-9fa9-ce981cabab2d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:15.588196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 413/832] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:16:15 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/7a79a7fbb30b45cd8677d84dd1b5c008/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:16:16.531638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1a98b-04f5-4ce0-8837-118be5148bbd None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:16.532229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1a98b-04f5-4ce0-8837-118be5148bbd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:16.532229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1a98b-04f5-4ce0-8837-118be5148bbd None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:16.533844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 420/833] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:16.539250 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acde047-4f5d-41a0-9c16-85992a4f8c34 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:16.539636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acde047-4f5d-41a0-9c16-85992a4f8c34 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:16.539820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acde047-4f5d-41a0-9c16-85992a4f8c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:16.557299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4acde047-4f5d-41a0-9c16-85992a4f8c34 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:16.558416 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4acde047-4f5d-41a0-9c16-85992a4f8c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:16.628496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 414/834] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:16.652325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1a98b-04f5-4ce0-8837-118be5148bbd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:16.735719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:16.764244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1a98b-04f5-4ce0-8837-118be5148bbd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:16.800303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f1da9-ca95-40a9-a9a4-4141c1b1b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:16.801375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f1da9-ca95-40a9-a9a4-4141c1b1b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:16.801805 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f1da9-ca95-40a9-a9a4-4141c1b1b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:16.802223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f1da9-ca95-40a9-a9a4-4141c1b1b4e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:16.813360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f1da9-ca95-40a9-a9a4-4141c1b1b4e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-823f1da9-ca95-40a9-a9a4-4141c1b1b4e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:16.821290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:16.822431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:16:16.823463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:16.825910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 421/835] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:16:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:16.833728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acde047-4f5d-41a0-9c16-85992a4f8c34 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:16.889078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:16.938084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acde047-4f5d-41a0-9c16-85992a4f8c34 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:16.973763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba95cef-425f-4d60-9f71-fa0850b4f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:16.974448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba95cef-425f-4d60-9f71-fa0850b4f5ac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:16.974733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba95cef-425f-4d60-9f71-fa0850b4f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:16.975013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba95cef-425f-4d60-9f71-fa0850b4f5ac None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:16.975773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba95cef-425f-4d60-9f71-fa0850b4f5ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:16.976115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba95cef-425f-4d60-9f71-fa0850b4f5ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:16.977646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba95cef-425f-4d60-9f71-fa0850b4f5ac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:16.986732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 415/836] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:16:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:16.992361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f1da9-ca95-40a9-a9a4-4141c1b1b4e4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:17.095015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f1da9-ca95-40a9-a9a4-4141c1b1b4e4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:17.134012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7666be8-aea2-41b4-a669-4cbc4527930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:17.135233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7666be8-aea2-41b4-a669-4cbc4527930c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:17.135735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7666be8-aea2-41b4-a669-4cbc4527930c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:17.136265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7666be8-aea2-41b4-a669-4cbc4527930c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:17.138868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:17.150066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7666be8-aea2-41b4-a669-4cbc4527930c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:17.151946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7666be8-aea2-41b4-a669-4cbc4527930c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f7666be8-aea2-41b4-a669-4cbc4527930c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:17.172239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:17.173210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:17.174090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:17.174090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:17.174090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:17.174090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:17.174090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 422/837] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:17.179140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba95cef-425f-4d60-9f71-fa0850b4f5ac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:17.287449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba95cef-425f-4d60-9f71-fa0850b4f5ac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:17.311254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:17.323001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb4265-3395-4123-9702-437f33cc53a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:17.323730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4265-3395-4123-9702-437f33cc53a1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:17.324035 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4265-3395-4123-9702-437f33cc53a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:17.324617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4265-3395-4123-9702-437f33cc53a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:17.325354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb4265-3395-4123-9702-437f33cc53a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:17.325787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb4265-3395-4123-9702-437f33cc53a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:17.327499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb4265-3395-4123-9702-437f33cc53a1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:17.340425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 416/838] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:17.346273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7666be8-aea2-41b4-a669-4cbc4527930c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:17.451309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7666be8-aea2-41b4-a669-4cbc4527930c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:17.474973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1c8f-7bee-479a-8644-039be21d608a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:17.475602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1c8f-7bee-479a-8644-039be21d608a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:17.476130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1c8f-7bee-479a-8644-039be21d608a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:17.477971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 417/839] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:17.483855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446e20-f072-4d5e-a396-e1c9063cafcd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:17.484556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446e20-f072-4d5e-a396-e1c9063cafcd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:17.485099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446e20-f072-4d5e-a396-e1c9063cafcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:17.487271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d132a2-adaf-4051-b4d5-6090a6854758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:17.488129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d132a2-adaf-4051-b4d5-6090a6854758 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:17.488415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d132a2-adaf-4051-b4d5-6090a6854758 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:17.488694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d132a2-adaf-4051-b4d5-6090a6854758 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:17.498237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d132a2-adaf-4051-b4d5-6090a6854758 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:17.499616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d132a2-adaf-4051-b4d5-6090a6854758 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:17.504818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-13446e20-f072-4d5e-a396-e1c9063cafcd None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:17.506260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-13446e20-f072-4d5e-a396-e1c9063cafcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b7d132a2-adaf-4051-b4d5-6090a6854758 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:17.515114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:17.516345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:17.517367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 423/840] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 4 18:16:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:17.523011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d132a2-adaf-4051-b4d5-6090a6854758 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:17.582508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 418/841] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:17.593158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:17.604680 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13446e20-f072-4d5e-a396-e1c9063cafcd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:17.652801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d132a2-adaf-4051-b4d5-6090a6854758 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:17.689583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3a4f0-21b5-4c51-8ec2-abcbb9b7076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:17.690262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3a4f0-21b5-4c51-8ec2-abcbb9b7076e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:17.690541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3a4f0-21b5-4c51-8ec2-abcbb9b7076e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:17.690811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3a4f0-21b5-4c51-8ec2-abcbb9b7076e None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:17.691653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3a4f0-21b5-4c51-8ec2-abcbb9b7076e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:17.691956 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3a4f0-21b5-4c51-8ec2-abcbb9b7076e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:17.693481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3a4f0-21b5-4c51-8ec2-abcbb9b7076e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:17.711291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13446e20-f072-4d5e-a396-e1c9063cafcd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:17.716221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 424/842] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 4 18:16:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:17.717810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764029e-2d73-4556-8bcf-10054163010d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:17.718103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764029e-2d73-4556-8bcf-10054163010d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:17.718380 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764029e-2d73-4556-8bcf-10054163010d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:17.719817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 425/843] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:17.723186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764029e-2d73-4556-8bcf-10054163010d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:17.723597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:17.752015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89720b-fb82-4bc3-8332-67970f54d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:17.752855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89720b-fb82-4bc3-8332-67970f54d616 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:17.753133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89720b-fb82-4bc3-8332-67970f54d616 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:17.753586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89720b-fb82-4bc3-8332-67970f54d616 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:17.754045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89720b-fb82-4bc3-8332-67970f54d616 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:17.755425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89720b-fb82-4bc3-8332-67970f54d616 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ca89720b-fb82-4bc3-8332-67970f54d616 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:17.767839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:17.768838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:17.769666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 419/844] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Jun 4 18:16:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:17.770505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0e03f-4f73-4ae4-8531-db88dfb14c81 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:17.770505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0e03f-4f73-4ae4-8531-db88dfb14c81 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:17.771347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0e03f-4f73-4ae4-8531-db88dfb14c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:17.787917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d2a0e03f-4f73-4ae4-8531-db88dfb14c81 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:17.789113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d2a0e03f-4f73-4ae4-8531-db88dfb14c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:17.833296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764029e-2d73-4556-8bcf-10054163010d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:17.836703 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:17.862520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 420/845] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:17.865162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0e03f-4f73-4ae4-8531-db88dfb14c81 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:17.870128 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16d9b5-903c-49c1-a7f1-37cfef5ca110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:17.870789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16d9b5-903c-49c1-a7f1-37cfef5ca110 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:17.871073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16d9b5-903c-49c1-a7f1-37cfef5ca110 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:17.871347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16d9b5-903c-49c1-a7f1-37cfef5ca110 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:17.944765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16d9b5-903c-49c1-a7f1-37cfef5ca110 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:17.946549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16d9b5-903c-49c1-a7f1-37cfef5ca110 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:17.973876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:17.977002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0e03f-4f73-4ae4-8531-db88dfb14c81 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:18.010210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b0ca0-e444-400b-ab13-488b1dd2943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:18.010882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b0ca0-e444-400b-ab13-488b1dd2943c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.011167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b0ca0-e444-400b-ab13-488b1dd2943c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.011445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b0ca0-e444-400b-ab13-488b1dd2943c None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.012190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b0ca0-e444-400b-ab13-488b1dd2943c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:18.012504 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b0ca0-e444-400b-ab13-488b1dd2943c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:18.014012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b0ca0-e444-400b-ab13-488b1dd2943c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:18.018888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 421/846] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:18.019671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b0ca0-e444-400b-ab13-488b1dd2943c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.045934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 426/847] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:16:18.047519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a5fcb-f999-430d-800d-e8a541cb3881 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.048034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a5fcb-f999-430d-800d-e8a541cb3881 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.048347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a5fcb-f999-430d-800d-e8a541cb3881 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.052175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 427/848] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:18.052175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a5fcb-f999-430d-800d-e8a541cb3881 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.054948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:18.121685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b0ca0-e444-400b-ab13-488b1dd2943c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:18.150129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a5fcb-f999-430d-800d-e8a541cb3881 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:18.157270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af8a6-58c7-423c-a12e-abf6decdc94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:18.158072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af8a6-58c7-423c-a12e-abf6decdc94a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.158350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af8a6-58c7-423c-a12e-abf6decdc94a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.158623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af8a6-58c7-423c-a12e-abf6decdc94a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.159267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83af8a6-58c7-423c-a12e-abf6decdc94a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:18.160715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83af8a6-58c7-423c-a12e-abf6decdc94a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f83af8a6-58c7-423c-a12e-abf6decdc94a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:18.172707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:18.173690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:18.174530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 422/849] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:18.175316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af8a6-58c7-423c-a12e-abf6decdc94a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.188516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f6a00-4efd-47c4-b6fb-5197cf11c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:18.189196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f6a00-4efd-47c4-b6fb-5197cf11c867 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.189477 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f6a00-4efd-47c4-b6fb-5197cf11c867 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.189745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f6a00-4efd-47c4-b6fb-5197cf11c867 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.190459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f6a00-4efd-47c4-b6fb-5197cf11c867 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:18.190760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f6a00-4efd-47c4-b6fb-5197cf11c867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:18.192246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f6a00-4efd-47c4-b6fb-5197cf11c867 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:18.196669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 428/850] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:18.197815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e4788-dd6f-464b-aadd-0a0f055a4736 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.198101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e4788-dd6f-464b-aadd-0a0f055a4736 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.198373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e4788-dd6f-464b-aadd-0a0f055a4736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.203518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:18.229302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d97e4788-dd6f-464b-aadd-0a0f055a4736 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:18.230671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d97e4788-dd6f-464b-aadd-0a0f055a4736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:18.285154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af8a6-58c7-423c-a12e-abf6decdc94a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:18.316312 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:18.332037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 429/851] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:18.332037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e4788-dd6f-464b-aadd-0a0f055a4736 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.332360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ece967-055e-4f59-a9d4-334a0af00e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:18.333196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ece967-055e-4f59-a9d4-334a0af00e00 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.333484 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ece967-055e-4f59-a9d4-334a0af00e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.334551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ece967-055e-4f59-a9d4-334a0af00e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.345909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ece967-055e-4f59-a9d4-334a0af00e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:18.347527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ece967-055e-4f59-a9d4-334a0af00e00 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-80ece967-055e-4f59-a9d4-334a0af00e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:18.367515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:18.368566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:18.369506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:18.369506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:18.369506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:18.369506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:18.369506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 423/852] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:18.369784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ece967-055e-4f59-a9d4-334a0af00e00 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.443701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e4788-dd6f-464b-aadd-0a0f055a4736 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:18.475135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:18.479867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd3df-bab2-4a4e-b917-6e1392b035ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:18.480556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd3df-bab2-4a4e-b917-6e1392b035ea None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.480843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd3df-bab2-4a4e-b917-6e1392b035ea None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.481117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd3df-bab2-4a4e-b917-6e1392b035ea None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.481888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bd3df-bab2-4a4e-b917-6e1392b035ea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:18.482220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bd3df-bab2-4a4e-b917-6e1392b035ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:18.483637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bd3df-bab2-4a4e-b917-6e1392b035ea None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:18.488727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 430/853] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:18.489754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd3df-bab2-4a4e-b917-6e1392b035ea None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.499868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ece967-055e-4f59-a9d4-334a0af00e00 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:18.535769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f95b1c-07ef-4b43-b76a-9cec6ea02e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:18.536707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f95b1c-07ef-4b43-b76a-9cec6ea02e4b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.537137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f95b1c-07ef-4b43-b76a-9cec6ea02e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.537419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f95b1c-07ef-4b43-b76a-9cec6ea02e4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.549153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f95b1c-07ef-4b43-b76a-9cec6ea02e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:18.551968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d1f95b1c-07ef-4b43-b76a-9cec6ea02e4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:18.558225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:18.559166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 424/854] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:18.560099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f95b1c-07ef-4b43-b76a-9cec6ea02e4b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.598096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd3df-bab2-4a4e-b917-6e1392b035ea None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:18.634817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b5d75-c009-4e4a-a710-c9bd7cfc2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:18.635482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5d75-c009-4e4a-a710-c9bd7cfc2841 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.635769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5d75-c009-4e4a-a710-c9bd7cfc2841 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.636065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5d75-c009-4e4a-a710-c9bd7cfc2841 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.636805 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b5d75-c009-4e4a-a710-c9bd7cfc2841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:18.637114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b5d75-c009-4e4a-a710-c9bd7cfc2841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:18.638546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b5d75-c009-4e4a-a710-c9bd7cfc2841 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:18.655795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 431/855] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:18.656607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b5d75-c009-4e4a-a710-c9bd7cfc2841 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.676047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f95b1c-07ef-4b43-b76a-9cec6ea02e4b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:18.715957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e39e5-3018-4483-bbca-90296187658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:18.716684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e39e5-3018-4483-bbca-90296187658c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.716968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e39e5-3018-4483-bbca-90296187658c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.717273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e39e5-3018-4483-bbca-90296187658c None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.717978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e39e5-3018-4483-bbca-90296187658c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:18.718280 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e39e5-3018-4483-bbca-90296187658c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:18.719677 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e39e5-3018-4483-bbca-90296187658c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:18.732038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 425/856] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:18.732038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e39e5-3018-4483-bbca-90296187658c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.734644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:18.774521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b5d75-c009-4e4a-a710-c9bd7cfc2841 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:18.800926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:18.817751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16618c35-55a9-450e-b39b-70d621177bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:18.818560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16618c35-55a9-450e-b39b-70d621177bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.818905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16618c35-55a9-450e-b39b-70d621177bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.819244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16618c35-55a9-450e-b39b-70d621177bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.820948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16618c35-55a9-450e-b39b-70d621177bb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:18.821321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16618c35-55a9-450e-b39b-70d621177bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:18.823328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16618c35-55a9-450e-b39b-70d621177bb4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:18.834588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 432/857] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:18.840114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16618c35-55a9-450e-b39b-70d621177bb4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.851364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e39e5-3018-4483-bbca-90296187658c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:18.888634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bee5a-a871-4274-ae39-2623f4b4be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:18.889663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bee5a-a871-4274-ae39-2623f4b4be4b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:18.890016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bee5a-a871-4274-ae39-2623f4b4be4b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:18.890362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bee5a-a871-4274-ae39-2623f4b4be4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:18.898050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bee5a-a871-4274-ae39-2623f4b4be4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:18.899638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bee5a-a871-4274-ae39-2623f4b4be4b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b90bee5a-a871-4274-ae39-2623f4b4be4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:18.915122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:18.916130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:18.917032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:18.917032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:18.917032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:18.917032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:18.917032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:18.917032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:18.917032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:18.917032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:18.921916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 426/858] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:18.925386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bee5a-a871-4274-ae39-2623f4b4be4b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:18.961709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16618c35-55a9-450e-b39b-70d621177bb4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:19.002553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b173d-47bf-437f-b8a1-788c999fb47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:19.003721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b173d-47bf-437f-b8a1-788c999fb47d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:19.004263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b173d-47bf-437f-b8a1-788c999fb47d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:19.004781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b173d-47bf-437f-b8a1-788c999fb47d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:19.007847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:19.017835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b173d-47bf-437f-b8a1-788c999fb47d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:19.019687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b173d-47bf-437f-b8a1-788c999fb47d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-393b173d-47bf-437f-b8a1-788c999fb47d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:19.039108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:19.040100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:19.041033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:19.041033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:19.041033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:19.041033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:19.043607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 433/859] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:19.050953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b173d-47bf-437f-b8a1-788c999fb47d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:19.055434 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bee5a-a871-4274-ae39-2623f4b4be4b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:19.093224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537744a-015d-4fa9-87e9-4d9389c06290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:19.094351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537744a-015d-4fa9-87e9-4d9389c06290 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:19.094821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537744a-015d-4fa9-87e9-4d9389c06290 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:19.095296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537744a-015d-4fa9-87e9-4d9389c06290 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:19.096303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537744a-015d-4fa9-87e9-4d9389c06290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:19.096789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537744a-015d-4fa9-87e9-4d9389c06290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:19.098056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:19.099766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537744a-015d-4fa9-87e9-4d9389c06290 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:19.114205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 427/860] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:19.119733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537744a-015d-4fa9-87e9-4d9389c06290 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:19.185286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b173d-47bf-437f-b8a1-788c999fb47d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:19.221174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb931-fa4d-41d6-af0b-f884edfc43e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:19.222223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb931-fa4d-41d6-af0b-f884edfc43e5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:19.222720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb931-fa4d-41d6-af0b-f884edfc43e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:19.223192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb931-fa4d-41d6-af0b-f884edfc43e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:19.224204 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcb931-fa4d-41d6-af0b-f884edfc43e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:19.224719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcb931-fa4d-41d6-af0b-f884edfc43e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:19.226300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcb931-fa4d-41d6-af0b-f884edfc43e5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:19.234080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537744a-015d-4fa9-87e9-4d9389c06290 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:19.240187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 434/861] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:19.245415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb931-fa4d-41d6-af0b-f884edfc43e5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:19.269981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:19.285685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd97ff-8b98-43bf-8f91-965eda3a3826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:19.286356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd97ff-8b98-43bf-8f91-965eda3a3826 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:19.286634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd97ff-8b98-43bf-8f91-965eda3a3826 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:19.286902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd97ff-8b98-43bf-8f91-965eda3a3826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:19.287735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd97ff-8b98-43bf-8f91-965eda3a3826 None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=733086955e19437e845f4f77c1178116) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:19.288065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd97ff-8b98-43bf-8f91-965eda3a3826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:19.289518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd97ff-8b98-43bf-8f91-965eda3a3826 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:19.302072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 428/862] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:19 2022] GET /identity/v3/role_assignments?user.id=733086955e19437e845f4f77c1178116&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:19.361242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:19.369018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb931-fa4d-41d6-af0b-f884edfc43e5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:19.409098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957419a-a8da-402a-97b9-c48782ee4af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:19.409923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957419a-a8da-402a-97b9-c48782ee4af9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:19.410201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957419a-a8da-402a-97b9-c48782ee4af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:19.410474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957419a-a8da-402a-97b9-c48782ee4af9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:19.419656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957419a-a8da-402a-97b9-c48782ee4af9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:19.421199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957419a-a8da-402a-97b9-c48782ee4af9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4957419a-a8da-402a-97b9-c48782ee4af9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:19.437179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:19.438180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:19.439099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 435/863] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:19.444383 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd97ff-8b98-43bf-8f91-965eda3a3826 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:19.553274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd97ff-8b98-43bf-8f91-965eda3a3826 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:19.590362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a96e64-61bb-4143-91f9-1a64b8e4c04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:19.591048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a96e64-61bb-4143-91f9-1a64b8e4c04a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:19.591421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a96e64-61bb-4143-91f9-1a64b8e4c04a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:19.591697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a96e64-61bb-4143-91f9-1a64b8e4c04a None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:19.592790 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a96e64-61bb-4143-91f9-1a64b8e4c04a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:19.593106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a96e64-61bb-4143-91f9-1a64b8e4c04a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:19.594556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a96e64-61bb-4143-91f9-1a64b8e4c04a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:19.613365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 429/864] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Jun 4 18:16:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:19.618714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957419a-a8da-402a-97b9-c48782ee4af9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:19.724501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957419a-a8da-402a-97b9-c48782ee4af9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:19.762825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd92420-67dc-439f-9d63-a7924f0175d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:19.763651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd92420-67dc-439f-9d63-a7924f0175d1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:19.764019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd92420-67dc-439f-9d63-a7924f0175d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:19.764303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd92420-67dc-439f-9d63-a7924f0175d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:19.789956 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:19.840706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd92420-67dc-439f-9d63-a7924f0175d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:19.842068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd92420-67dc-439f-9d63-a7924f0175d1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:19.941458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 436/865] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 18:16:19.947052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a96e64-61bb-4143-91f9-1a64b8e4c04a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:19.999422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:20.053892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a96e64-61bb-4143-91f9-1a64b8e4c04a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:20.088344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57af5a-1d42-4b87-9144-153475ad0511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:20.089147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57af5a-1d42-4b87-9144-153475ad0511 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:20.089428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57af5a-1d42-4b87-9144-153475ad0511 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:20.089700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57af5a-1d42-4b87-9144-153475ad0511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:20.100552 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57af5a-1d42-4b87-9144-153475ad0511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:20.101953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57af5a-1d42-4b87-9144-153475ad0511 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-be57af5a-1d42-4b87-9144-153475ad0511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:20.119843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:20.121996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:20.124180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:20.124180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:20.124180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:20.124180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:20.124180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 430/866] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:20.127216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd92420-67dc-439f-9d63-a7924f0175d1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:20.187102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:20.233632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd92420-67dc-439f-9d63-a7924f0175d1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:20.268504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03502c91-76e5-4d7c-a968-1ae7f96a4278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:20.269185 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03502c91-76e5-4d7c-a968-1ae7f96a4278 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:20.269464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03502c91-76e5-4d7c-a968-1ae7f96a4278 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:20.269738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03502c91-76e5-4d7c-a968-1ae7f96a4278 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:20.270596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03502c91-76e5-4d7c-a968-1ae7f96a4278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:20.270900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03502c91-76e5-4d7c-a968-1ae7f96a4278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:20.274955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03502c91-76e5-4d7c-a968-1ae7f96a4278 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:20.286566 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 437/867] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:20.296946 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57af5a-1d42-4b87-9144-153475ad0511 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:20.404495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:20.408528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57af5a-1d42-4b87-9144-153475ad0511 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:20.443152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8ed06-9f3f-4700-8255-97912ced7f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:20.443954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8ed06-9f3f-4700-8255-97912ced7f77 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:20.444257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8ed06-9f3f-4700-8255-97912ced7f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:20.444526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8ed06-9f3f-4700-8255-97912ced7f77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:20.451523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8ed06-9f3f-4700-8255-97912ced7f77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:20.453016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8ed06-9f3f-4700-8255-97912ced7f77 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5cb8ed06-9f3f-4700-8255-97912ced7f77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:20.466610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:20.467562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:20.468587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:20.468587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:20.468587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:20.468587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:20.468587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:20.468587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:20.468587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:20.468587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:20.468587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 431/868] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:20.477110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03502c91-76e5-4d7c-a968-1ae7f96a4278 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:20.519299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac930de-2698-4b5c-9344-7cc212ee6689 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:20.519642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac930de-2698-4b5c-9344-7cc212ee6689 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:20.519857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac930de-2698-4b5c-9344-7cc212ee6689 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:20.521488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 432/869] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:20.526240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d841ef-9549-4f45-897f-bda16481f457 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:20.526528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d841ef-9549-4f45-897f-bda16481f457 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:20.526807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d841ef-9549-4f45-897f-bda16481f457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:20.546528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-13d841ef-9549-4f45-897f-bda16481f457 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:20.547743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-13d841ef-9549-4f45-897f-bda16481f457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:20.589222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03502c91-76e5-4d7c-a968-1ae7f96a4278 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:20.609861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:20.625925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 433/870] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:20.632768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f702fdc-54e4-42d9-ba9f-09b3df41e15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:20.633971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702fdc-54e4-42d9-ba9f-09b3df41e15f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:20.634394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702fdc-54e4-42d9-ba9f-09b3df41e15f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:20.634809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f702fdc-54e4-42d9-ba9f-09b3df41e15f None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:20.635746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702fdc-54e4-42d9-ba9f-09b3df41e15f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:20.636345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702fdc-54e4-42d9-ba9f-09b3df41e15f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:20.638029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f702fdc-54e4-42d9-ba9f-09b3df41e15f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:20.648532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d841ef-9549-4f45-897f-bda16481f457 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:20.657102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 438/871] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:20.658368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f702fdc-54e4-42d9-ba9f-09b3df41e15f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:20.749340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d841ef-9549-4f45-897f-bda16481f457 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:20.761036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:20.778261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f702fdc-54e4-42d9-ba9f-09b3df41e15f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:20.787767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ba913-5956-4aa2-a131-1511b62cb854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:20.788596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ba913-5956-4aa2-a131-1511b62cb854 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:20.789297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ba913-5956-4aa2-a131-1511b62cb854 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:20.789297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ba913-5956-4aa2-a131-1511b62cb854 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:20.790138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ba913-5956-4aa2-a131-1511b62cb854 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:20.791741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ba913-5956-4aa2-a131-1511b62cb854 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:20.812338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 434/872] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:16:20 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:16:20.836516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70fa96-9dbe-4831-a869-895754da2e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:20.837606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70fa96-9dbe-4831-a869-895754da2e62 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:20.838189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70fa96-9dbe-4831-a869-895754da2e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:20.838624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70fa96-9dbe-4831-a869-895754da2e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:20.839675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70fa96-9dbe-4831-a869-895754da2e62 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=7a79a7fbb30b45cd8677d84dd1b5c008) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:20.840189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70fa96-9dbe-4831-a869-895754da2e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:20.842122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70fa96-9dbe-4831-a869-895754da2e62 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:20.850594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 439/873] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:20 2022] GET /identity/v3/role_assignments?user.id=7a79a7fbb30b45cd8677d84dd1b5c008&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=9f557e97d94b4b499a6765419452e1ef => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:21.165305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab289-cb6c-413e-9543-249f5eb65d0a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:21.165862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab289-cb6c-413e-9543-249f5eb65d0a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:21.165862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab289-cb6c-413e-9543-249f5eb65d0a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:21.167820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 435/874] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:21.173344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e215a9-07d4-4f76-bb0b-c8a1e4816830 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:21.173630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e215a9-07d4-4f76-bb0b-c8a1e4816830 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:21.173905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e215a9-07d4-4f76-bb0b-c8a1e4816830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:21.191354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a7e215a9-07d4-4f76-bb0b-c8a1e4816830 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:21.192580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a7e215a9-07d4-4f76-bb0b-c8a1e4816830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:21.222440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:21.267770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 440/875] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:21 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:21.286514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab289-cb6c-413e-9543-249f5eb65d0a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:21.395087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab289-cb6c-413e-9543-249f5eb65d0a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:21.433242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8f5fc-8237-41f0-a9b0-f942d9934d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:21.433948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f5fc-8237-41f0-a9b0-f942d9934d74 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:21.434226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f5fc-8237-41f0-a9b0-f942d9934d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:21.434506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f5fc-8237-41f0-a9b0-f942d9934d74 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:21.435323 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8f5fc-8237-41f0-a9b0-f942d9934d74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:21.436993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8f5fc-8237-41f0-a9b0-f942d9934d74 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:21.457478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 436/876] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:16:21 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:21.765362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8689d-370d-4aff-8682-ff20941b7ac8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:21.765876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8689d-370d-4aff-8682-ff20941b7ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:21.765876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8689d-370d-4aff-8682-ff20941b7ac8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:21.767455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 441/877] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:21.773206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637e1f5-8124-413e-a798-4208203fd9c9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:21.773497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637e1f5-8124-413e-a798-4208203fd9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:21.773771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637e1f5-8124-413e-a798-4208203fd9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:21.790670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e637e1f5-8124-413e-a798-4208203fd9c9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:21.791850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e637e1f5-8124-413e-a798-4208203fd9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:21.794236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:21.872115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 437/878] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:21.889840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8689d-370d-4aff-8682-ff20941b7ac8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:21.998062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8689d-370d-4aff-8682-ff20941b7ac8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:22.033190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409b556-0948-462b-a0d9-4b5641b83963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:22.033996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b556-0948-462b-a0d9-4b5641b83963 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:22.034281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b556-0948-462b-a0d9-4b5641b83963 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:22.034555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b556-0948-462b-a0d9-4b5641b83963 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:22.047127 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409b556-0948-462b-a0d9-4b5641b83963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b409b556-0948-462b-a0d9-4b5641b83963 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:22.055775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:22.056815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:22.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 442/879] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 4 18:16:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:22.065430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637e1f5-8124-413e-a798-4208203fd9c9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:22.171666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637e1f5-8124-413e-a798-4208203fd9c9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:22.207299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394157-27fb-4168-968f-f1f5cac04baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:22.207981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394157-27fb-4168-968f-f1f5cac04baf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:22.208295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394157-27fb-4168-968f-f1f5cac04baf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:22.208574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394157-27fb-4168-968f-f1f5cac04baf None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:22.209333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b394157-27fb-4168-968f-f1f5cac04baf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:22.209641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b394157-27fb-4168-968f-f1f5cac04baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:22.211027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b394157-27fb-4168-968f-f1f5cac04baf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:22.212426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:22.220509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 438/880] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 4 18:16:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:22.229125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409b556-0948-462b-a0d9-4b5641b83963 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:22.257904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:22.337027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409b556-0948-462b-a0d9-4b5641b83963 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:22.370984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606e9e6-d526-4f80-b1e2-db97db6f698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:22.371781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606e9e6-d526-4f80-b1e2-db97db6f698a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:22.372081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606e9e6-d526-4f80-b1e2-db97db6f698a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:22.372430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606e9e6-d526-4f80-b1e2-db97db6f698a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:22.383083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606e9e6-d526-4f80-b1e2-db97db6f698a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:22.384580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606e9e6-d526-4f80-b1e2-db97db6f698a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e606e9e6-d526-4f80-b1e2-db97db6f698a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:22.401672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:22.402551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:22.403415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:22.403415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:22.403415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:22.403415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:22.407698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 443/881] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:22.409075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394157-27fb-4168-968f-f1f5cac04baf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:22.510449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394157-27fb-4168-968f-f1f5cac04baf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:22.549728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084b453-a21e-475e-b0a2-24d3bd3fb9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:22.550403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084b453-a21e-475e-b0a2-24d3bd3fb9ce None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:22.550684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084b453-a21e-475e-b0a2-24d3bd3fb9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:22.550962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084b453-a21e-475e-b0a2-24d3bd3fb9ce None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:22.551688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084b453-a21e-475e-b0a2-24d3bd3fb9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:22.551994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084b453-a21e-475e-b0a2-24d3bd3fb9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:22.553419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084b453-a21e-475e-b0a2-24d3bd3fb9ce None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:22.572205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 439/882] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:22.573613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606e9e6-d526-4f80-b1e2-db97db6f698a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:22.660297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:22.682806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606e9e6-d526-4f80-b1e2-db97db6f698a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:22.717534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344d1d7-e238-46a8-b1ae-59b8bcaa0dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:22.718371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344d1d7-e238-46a8-b1ae-59b8bcaa0dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:22.718653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344d1d7-e238-46a8-b1ae-59b8bcaa0dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:22.718926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344d1d7-e238-46a8-b1ae-59b8bcaa0dd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:22.727048 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344d1d7-e238-46a8-b1ae-59b8bcaa0dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:22.728567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344d1d7-e238-46a8-b1ae-59b8bcaa0dd9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-9344d1d7-e238-46a8-b1ae-59b8bcaa0dd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:22.743599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:22.745745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:22.747846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 444/883] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 4 18:16:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:22.751568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084b453-a21e-475e-b0a2-24d3bd3fb9ce None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:22.814594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:22.860066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084b453-a21e-475e-b0a2-24d3bd3fb9ce None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:22.898340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149916fb-6887-40df-b77c-03e8b6886588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:22.899448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149916fb-6887-40df-b77c-03e8b6886588 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:22.899954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149916fb-6887-40df-b77c-03e8b6886588 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:22.900454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149916fb-6887-40df-b77c-03e8b6886588 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:22.901544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149916fb-6887-40df-b77c-03e8b6886588 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:22.902062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149916fb-6887-40df-b77c-03e8b6886588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:22.903888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149916fb-6887-40df-b77c-03e8b6886588 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:22.925966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 440/884] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 4 18:16:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:22.933388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344d1d7-e238-46a8-b1ae-59b8bcaa0dd9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:23.041904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344d1d7-e238-46a8-b1ae-59b8bcaa0dd9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:23.077163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053a9e5-0489-4264-a869-59404eb0e2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:23.077830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053a9e5-0489-4264-a869-59404eb0e2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.078160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053a9e5-0489-4264-a869-59404eb0e2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.078441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053a9e5-0489-4264-a869-59404eb0e2a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.087400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:23.148374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053a9e5-0489-4264-a869-59404eb0e2a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:23.149757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053a9e5-0489-4264-a869-59404eb0e2a7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:23.237015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33bd1-6adb-452d-9768-9e62b5ad4dbe None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.237536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33bd1-6adb-452d-9768-9e62b5ad4dbe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.237646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33bd1-6adb-452d-9768-9e62b5ad4dbe None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.239204 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 441/885] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:16:23.244191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66861a25-2794-462e-82d0-57f0288f5c39 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.244484 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66861a25-2794-462e-82d0-57f0288f5c39 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.244769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66861a25-2794-462e-82d0-57f0288f5c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.251444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 445/886] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:22 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:16:23.256957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053a9e5-0489-4264-a869-59404eb0e2a7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:23.264226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-66861a25-2794-462e-82d0-57f0288f5c39 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:23.266043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-66861a25-2794-462e-82d0-57f0288f5c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:23.303702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:23.353370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 442/887] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:23.354987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce729bf4-60e5-458c-b8d0-8054608ca260 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.355444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce729bf4-60e5-458c-b8d0-8054608ca260 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.355870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce729bf4-60e5-458c-b8d0-8054608ca260 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.357352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 443/888] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:23.362703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30007c65-bf07-41cf-85bc-51a97642b1d9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.363251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30007c65-bf07-41cf-85bc-51a97642b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.363723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30007c65-bf07-41cf-85bc-51a97642b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.380928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053a9e5-0489-4264-a869-59404eb0e2a7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:23.382285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-30007c65-bf07-41cf-85bc-51a97642b1d9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:23.383469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-30007c65-bf07-41cf-85bc-51a97642b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:23.416704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6bfb0-6eb0-4758-84f5-0a02213b5181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:23.417791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6bfb0-6eb0-4758-84f5-0a02213b5181 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.418049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6bfb0-6eb0-4758-84f5-0a02213b5181 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.418324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6bfb0-6eb0-4758-84f5-0a02213b5181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.427410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:23.428960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6bfb0-6eb0-4758-84f5-0a02213b5181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:23.430479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6bfb0-6eb0-4758-84f5-0a02213b5181 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d3a6bfb0-6eb0-4758-84f5-0a02213b5181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:23.448341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:23.449276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:23.455445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:23.455445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:23.455445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:23.455445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:23.455445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 446/889] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:23.455445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6bfb0-6eb0-4758-84f5-0a02213b5181 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:23.463049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 444/890] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:23.469078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30007c65-bf07-41cf-85bc-51a97642b1d9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:23.547787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:23.559592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6bfb0-6eb0-4758-84f5-0a02213b5181 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:23.582966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30007c65-bf07-41cf-85bc-51a97642b1d9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:23.598529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3086-8d33-44e8-81c7-07e075e95a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:23.599451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3086-8d33-44e8-81c7-07e075e95a71 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.599797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3086-8d33-44e8-81c7-07e075e95a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.600116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b3086-8d33-44e8-81c7-07e075e95a71 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.600790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b3086-8d33-44e8-81c7-07e075e95a71 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:23.602195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b3086-8d33-44e8-81c7-07e075e95a71 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-178b3086-8d33-44e8-81c7-07e075e95a71 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:23.614606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:23.615771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:23.616652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 447/891] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Jun 4 18:16:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:23.617500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3086-8d33-44e8-81c7-07e075e95a71 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:23.623849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca277bb-141d-415a-9ac4-0448caf750f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:23.624743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca277bb-141d-415a-9ac4-0448caf750f5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.625031 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca277bb-141d-415a-9ac4-0448caf750f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.625347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca277bb-141d-415a-9ac4-0448caf750f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.626051 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca277bb-141d-415a-9ac4-0448caf750f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:23.626361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca277bb-141d-415a-9ac4-0448caf750f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:23.627761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca277bb-141d-415a-9ac4-0448caf750f5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:23.640857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 445/892] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:23.645979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca277bb-141d-415a-9ac4-0448caf750f5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:23.691364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:23.742987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b3086-8d33-44e8-81c7-07e075e95a71 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:23.762686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca277bb-141d-415a-9ac4-0448caf750f5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:23.781406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84954dbf-443e-47d5-a9e3-bdd3a5cb981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:23.782393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84954dbf-443e-47d5-a9e3-bdd3a5cb981e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.782691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84954dbf-443e-47d5-a9e3-bdd3a5cb981e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.782969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84954dbf-443e-47d5-a9e3-bdd3a5cb981e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.783607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84954dbf-443e-47d5-a9e3-bdd3a5cb981e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:23.785018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84954dbf-443e-47d5-a9e3-bdd3a5cb981e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-84954dbf-443e-47d5-a9e3-bdd3a5cb981e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:23.797442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:23.798592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:23.799408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 448/893] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:23.800725 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84954dbf-443e-47d5-a9e3-bdd3a5cb981e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:23.805814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9933b-9777-4bb4-8a88-5a9530a1df8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:23.806513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9933b-9777-4bb4-8a88-5a9530a1df8f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.806799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9933b-9777-4bb4-8a88-5a9530a1df8f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.807083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9933b-9777-4bb4-8a88-5a9530a1df8f None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.807801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9933b-9777-4bb4-8a88-5a9530a1df8f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:23.808147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9933b-9777-4bb4-8a88-5a9530a1df8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:23.809544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9933b-9777-4bb4-8a88-5a9530a1df8f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:23.820046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 446/894] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:23.820046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9933b-9777-4bb4-8a88-5a9530a1df8f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:23.824226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:23.907408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84954dbf-443e-47d5-a9e3-bdd3a5cb981e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:23.928620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:23.932740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9933b-9777-4bb4-8a88-5a9530a1df8f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:23.940917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f9005-fdd4-42ea-986d-f3c6688025ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:23.941888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f9005-fdd4-42ea-986d-f3c6688025ff None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.942124 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f9005-fdd4-42ea-986d-f3c6688025ff None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.942402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f9005-fdd4-42ea-986d-f3c6688025ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.949175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f9005-fdd4-42ea-986d-f3c6688025ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:23.950886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f9005-fdd4-42ea-986d-f3c6688025ff None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-de0f9005-fdd4-42ea-986d-f3c6688025ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:23.965284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:23.966408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:23.967298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:23.967298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:23.967298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:23.967298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:23.967298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:23.967298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:23.967298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:23.967298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:23.967708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dc959-73ec-43f0-a301-cd8d06999f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:23.967708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dc959-73ec-43f0-a301-cd8d06999f38 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.967708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dc959-73ec-43f0-a301-cd8d06999f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.967708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dc959-73ec-43f0-a301-cd8d06999f38 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.967981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 449/895] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:23.968459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dc959-73ec-43f0-a301-cd8d06999f38 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:23.968459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dc959-73ec-43f0-a301-cd8d06999f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:23.968606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f9005-fdd4-42ea-986d-f3c6688025ff None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:23.969369 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dc959-73ec-43f0-a301-cd8d06999f38 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:23.978847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 447/896] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 4 18:16:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:23.978847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf30c-6bde-4e76-91b1-c96df4306972 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:23.978847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf30c-6bde-4e76-91b1-c96df4306972 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:23.978847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf30c-6bde-4e76-91b1-c96df4306972 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:23.978847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 448/897] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:23.978847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaf30c-6bde-4e76-91b1-c96df4306972 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:24.052058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:24.073695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f9005-fdd4-42ea-986d-f3c6688025ff None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:24.085995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaf30c-6bde-4e76-91b1-c96df4306972 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:24.109052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5f1e6-836c-45ee-afe8-b4253d85173a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:24.109726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5f1e6-836c-45ee-afe8-b4253d85173a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:24.109995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5f1e6-836c-45ee-afe8-b4253d85173a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:24.110272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5f1e6-836c-45ee-afe8-b4253d85173a None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:24.110990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5f1e6-836c-45ee-afe8-b4253d85173a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:24.111301 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5f1e6-836c-45ee-afe8-b4253d85173a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:24.112723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5f1e6-836c-45ee-afe8-b4253d85173a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:24.117417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 450/898] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:24.118180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5f1e6-836c-45ee-afe8-b4253d85173a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:24.124492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bb7c8-7d60-4a06-80d8-65b679cf7369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:24.125163 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bb7c8-7d60-4a06-80d8-65b679cf7369 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:24.125439 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bb7c8-7d60-4a06-80d8-65b679cf7369 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:24.125714 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bb7c8-7d60-4a06-80d8-65b679cf7369 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:24.126490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bb7c8-7d60-4a06-80d8-65b679cf7369 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:24.126797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bb7c8-7d60-4a06-80d8-65b679cf7369 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:24.128246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bb7c8-7d60-4a06-80d8-65b679cf7369 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:24.145156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 449/899] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:24.145156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0c9ae-bdfd-45ea-9bcf-81fa3f2c9d5b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:24.145156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0c9ae-bdfd-45ea-9bcf-81fa3f2c9d5b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:24.145156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0c9ae-bdfd-45ea-9bcf-81fa3f2c9d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:24.159778 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fad0c9ae-bdfd-45ea-9bcf-81fa3f2c9d5b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:24.160984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fad0c9ae-bdfd-45ea-9bcf-81fa3f2c9d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:24.178699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:24.217723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5f1e6-836c-45ee-afe8-b4253d85173a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:24.229658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 450/900] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:24.230483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0c9ae-bdfd-45ea-9bcf-81fa3f2c9d5b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:24.253267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50689104-1952-473e-a866-7c2a0cc10186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:24.253933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689104-1952-473e-a866-7c2a0cc10186 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:24.254216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689104-1952-473e-a866-7c2a0cc10186 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:24.254492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689104-1952-473e-a866-7c2a0cc10186 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:24.255208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50689104-1952-473e-a866-7c2a0cc10186 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:24.255516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50689104-1952-473e-a866-7c2a0cc10186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:24.256933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50689104-1952-473e-a866-7c2a0cc10186 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:24.269299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 451/901] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 4 18:16:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:24.269299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50689104-1952-473e-a866-7c2a0cc10186 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:24.271307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:24.359298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0c9ae-bdfd-45ea-9bcf-81fa3f2c9d5b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:24.383794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50689104-1952-473e-a866-7c2a0cc10186 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:24.404629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd139f-1e74-4608-bf4d-6638ad623f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:24.405322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd139f-1e74-4608-bf4d-6638ad623f16 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:24.405605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd139f-1e74-4608-bf4d-6638ad623f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:24.405880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd139f-1e74-4608-bf4d-6638ad623f16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:24.406697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd139f-1e74-4608-bf4d-6638ad623f16 None admin] RBAC: Adding query filter params (interface=public, service_id=c7e3db4153e44875bf7a8c3774d60ee6, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:24.407012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd139f-1e74-4608-bf4d-6638ad623f16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:24.408482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd139f-1e74-4608-bf4d-6638ad623f16 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:24.414934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 451/902] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 4 18:16:24 2022] GET /identity/v3/endpoints?service_id=c7e3db4153e44875bf7a8c3774d60ee6&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:24.415822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd139f-1e74-4608-bf4d-6638ad623f16 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:24.428742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4884d8d-3c9f-45a9-92ee-662488ab79e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:24.429420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884d8d-3c9f-45a9-92ee-662488ab79e9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:24.429707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884d8d-3c9f-45a9-92ee-662488ab79e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:24.429989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884d8d-3c9f-45a9-92ee-662488ab79e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:24.430841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4884d8d-3c9f-45a9-92ee-662488ab79e9 None admin] RBAC: Adding query filter params (role.id=1cd3a93991ad4a08a7fbdc65ace3e21e, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=733086955e19437e845f4f77c1178116) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:24.431156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4884d8d-3c9f-45a9-92ee-662488ab79e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:24.432689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4884d8d-3c9f-45a9-92ee-662488ab79e9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:24.435961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:24.448116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 452/903] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:24 2022] GET /identity/v3/role_assignments?user.id=733086955e19437e845f4f77c1178116&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=1cd3a93991ad4a08a7fbdc65ace3e21e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:24.450257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4884d8d-3c9f-45a9-92ee-662488ab79e9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:24.543509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:24.548101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd139f-1e74-4608-bf4d-6638ad623f16 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:24.580101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4884d8d-3c9f-45a9-92ee-662488ab79e9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:24.587587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958b4be-b473-45a1-b3d0-81608a96403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:24.588592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b4be-b473-45a1-b3d0-81608a96403c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:24.588963 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b4be-b473-45a1-b3d0-81608a96403c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:24.589349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b4be-b473-45a1-b3d0-81608a96403c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:24.590167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958b4be-b473-45a1-b3d0-81608a96403c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:24.592178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958b4be-b473-45a1-b3d0-81608a96403c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5958b4be-b473-45a1-b3d0-81608a96403c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:24.605237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:24.606297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:24.607203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 452/904] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:16:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:24.614960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958b4be-b473-45a1-b3d0-81608a96403c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:24.625023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc7965-e289-4d98-af87-5253d336fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:24.626874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc7965-e289-4d98-af87-5253d336fb39 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:24.627405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc7965-e289-4d98-af87-5253d336fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:24.627965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc7965-e289-4d98-af87-5253d336fb39 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:24.629357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc7965-e289-4d98-af87-5253d336fb39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:24.631018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc7965-e289-4d98-af87-5253d336fb39 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:24.640688 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 453/905] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 4 18:16:24 2022] GET /identity/v3/services => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:16:24.720445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:24.737427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958b4be-b473-45a1-b3d0-81608a96403c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:24.775572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaca188-be8b-4071-b303-9dbf9a4ea76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:24.776287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaca188-be8b-4071-b303-9dbf9a4ea76a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:24.776574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaca188-be8b-4071-b303-9dbf9a4ea76a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:24.776859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaca188-be8b-4071-b303-9dbf9a4ea76a None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:24.777590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaca188-be8b-4071-b303-9dbf9a4ea76a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:24.777900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaca188-be8b-4071-b303-9dbf9a4ea76a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:24.779402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaca188-be8b-4071-b303-9dbf9a4ea76a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:24.785333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 453/906] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:16:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:24.791101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc7965-e289-4d98-af87-5253d336fb39 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:24.906507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc7965-e289-4d98-af87-5253d336fb39 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:24.944097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e099a-63bc-4b74-8372-6e6c2c10af94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:24.944874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e099a-63bc-4b74-8372-6e6c2c10af94 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:24.945066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e099a-63bc-4b74-8372-6e6c2c10af94 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:24.945346 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e099a-63bc-4b74-8372-6e6c2c10af94 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:24.946067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e099a-63bc-4b74-8372-6e6c2c10af94 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:24.946375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e099a-63bc-4b74-8372-6e6c2c10af94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:24.947771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e099a-63bc-4b74-8372-6e6c2c10af94 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:24.953520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 454/907] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:16:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:24.956325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:24.959428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaca188-be8b-4071-b303-9dbf9a4ea76a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:25.065677 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaca188-be8b-4071-b303-9dbf9a4ea76a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:25.101059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172fb75-bfa0-4d98-ae2c-02c4af195000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:25.101732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172fb75-bfa0-4d98-ae2c-02c4af195000 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:25.102017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172fb75-bfa0-4d98-ae2c-02c4af195000 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:25.102299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172fb75-bfa0-4d98-ae2c-02c4af195000 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:25.103103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172fb75-bfa0-4d98-ae2c-02c4af195000 None admin] RBAC: Adding query filter params (interface=public, service_id=5cd6808f92a94d0fb31c6e7216223ed9, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:25.103421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172fb75-bfa0-4d98-ae2c-02c4af195000 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:25.104843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172fb75-bfa0-4d98-ae2c-02c4af195000 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:25.110743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 454/908] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 4 18:16:24 2022] GET /identity/v3/endpoints?service_id=5cd6808f92a94d0fb31c6e7216223ed9&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:25.116207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e099a-63bc-4b74-8372-6e6c2c10af94 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:25.224920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e099a-63bc-4b74-8372-6e6c2c10af94 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:25.262986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcaaa4-ab8b-4fd7-8119-fdd5b434cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:25.263804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcaaa4-ab8b-4fd7-8119-fdd5b434cba5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:25.264179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcaaa4-ab8b-4fd7-8119-fdd5b434cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:25.264463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcaaa4-ab8b-4fd7-8119-fdd5b434cba5 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:25.265158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcaaa4-ab8b-4fd7-8119-fdd5b434cba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:25.266546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcaaa4-ab8b-4fd7-8119-fdd5b434cba5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:25.272751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 455/909] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 4 18:16:25 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:16:26.581994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec62dee-6cd7-4796-98a1-0e13a5207027 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:26.582491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec62dee-6cd7-4796-98a1-0e13a5207027 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:26.582491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec62dee-6cd7-4796-98a1-0e13a5207027 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:26.584053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 455/910] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:26.589512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf787b-5679-4800-9cc6-840e84734f1b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:26.589930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf787b-5679-4800-9cc6-840e84734f1b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:26.590098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf787b-5679-4800-9cc6-840e84734f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:26.606850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-45cf787b-5679-4800-9cc6-840e84734f1b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:26.608133 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-45cf787b-5679-4800-9cc6-840e84734f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:26.666925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:26.684548 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 456/911] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:26.708324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec62dee-6cd7-4796-98a1-0e13a5207027 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:26.720000 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:26.815088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec62dee-6cd7-4796-98a1-0e13a5207027 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:26.850238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e7080-94d9-48a4-bb48-006bd4533753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:26.850826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e7080-94d9-48a4-bb48-006bd4533753 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:26.851105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e7080-94d9-48a4-bb48-006bd4533753 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:26.851375 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e7080-94d9-48a4-bb48-006bd4533753 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:26.852133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e7080-94d9-48a4-bb48-006bd4533753 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:26.853508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e7080-94d9-48a4-bb48-006bd4533753 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:26.861837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7592054-5cbe-462c-ad99-5581ff0ceea2 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:26.862130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7592054-5cbe-462c-ad99-5581ff0ceea2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:26.862413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7592054-5cbe-462c-ad99-5581ff0ceea2 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:26.863927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 457/912] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:16:26.869248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56b1de-13fe-4776-8cb2-2286989f5c7a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:26.869545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56b1de-13fe-4776-8cb2-2286989f5c7a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:26.869828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56b1de-13fe-4776-8cb2-2286989f5c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:26.875059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 456/913] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:16:26 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:26.889516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8c56b1de-13fe-4776-8cb2-2286989f5c7a None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:26.891020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8c56b1de-13fe-4776-8cb2-2286989f5c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:26.978621 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 458/914] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:27.001941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e7080-94d9-48a4-bb48-006bd4533753 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:27.057905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039b94-c013-4dba-ac30-cae885652a90 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.058246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039b94-c013-4dba-ac30-cae885652a90 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.058460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee039b94-c013-4dba-ac30-cae885652a90 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.060154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 459/915] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:27.067662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd01e1-f92a-4195-8cbe-a8da640aeecd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.067913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd01e1-f92a-4195-8cbe-a8da640aeecd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.068549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd01e1-f92a-4195-8cbe-a8da640aeecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.087663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:27.089101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-04fd01e1-f92a-4195-8cbe-a8da640aeecd None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:27.090651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-04fd01e1-f92a-4195-8cbe-a8da640aeecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:27.135319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e7080-94d9-48a4-bb48-006bd4533753 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:27.179734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ba32b-73a3-43c1-9acc-4d0008a08065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:27.180601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ba32b-73a3-43c1-9acc-4d0008a08065 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.180887 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ba32b-73a3-43c1-9acc-4d0008a08065 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.181167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ba32b-73a3-43c1-9acc-4d0008a08065 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.188276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 460/916] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:27.194663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ba32b-73a3-43c1-9acc-4d0008a08065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-449ba32b-73a3-43c1-9acc-4d0008a08065 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:27.203260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:27.204287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:27.205248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 457/917] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 4 18:16:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:27.210887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd01e1-f92a-4195-8cbe-a8da640aeecd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:27.215779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ba32b-73a3-43c1-9acc-4d0008a08065 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:27.276421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:27.328729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd01e1-f92a-4195-8cbe-a8da640aeecd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:27.364729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ba32b-73a3-43c1-9acc-4d0008a08065 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:27.372725 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c663f-7a6b-444f-b7fb-44e2b0ab6daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:27.373812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c663f-7a6b-444f-b7fb-44e2b0ab6daa None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.374267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c663f-7a6b-444f-b7fb-44e2b0ab6daa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.375009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c663f-7a6b-444f-b7fb-44e2b0ab6daa None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.376240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c663f-7a6b-444f-b7fb-44e2b0ab6daa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:27.376718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c663f-7a6b-444f-b7fb-44e2b0ab6daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:27.378554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c663f-7a6b-444f-b7fb-44e2b0ab6daa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:27.390882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 461/918] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 4 18:16:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:27.396332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c663f-7a6b-444f-b7fb-44e2b0ab6daa None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:27.397876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:27.407882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57525f02-d7d0-4477-9234-e867fed08e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:27.408740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57525f02-d7d0-4477-9234-e867fed08e34 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.409025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57525f02-d7d0-4477-9234-e867fed08e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.409305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57525f02-d7d0-4477-9234-e867fed08e34 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.409966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57525f02-d7d0-4477-9234-e867fed08e34 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:27.411376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57525f02-d7d0-4477-9234-e867fed08e34 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-57525f02-d7d0-4477-9234-e867fed08e34 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:27.424642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:27.425792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:27.426629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 458/919] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Jun 4 18:16:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:27.431873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57525f02-d7d0-4477-9234-e867fed08e34 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:27.519593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c663f-7a6b-444f-b7fb-44e2b0ab6daa None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:27.531761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:27.556318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57525f02-d7d0-4477-9234-e867fed08e34 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:27.566518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bd217-bf92-4668-abff-ec2a87cac137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:27.567342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bd217-bf92-4668-abff-ec2a87cac137 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.567627 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bd217-bf92-4668-abff-ec2a87cac137 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.567903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bd217-bf92-4668-abff-ec2a87cac137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.579832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bd217-bf92-4668-abff-ec2a87cac137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:27.581340 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bd217-bf92-4668-abff-ec2a87cac137 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:27.593549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5e604-2d3b-4361-ae75-efa87bd4db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:27.594220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e604-2d3b-4361-ae75-efa87bd4db5f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.594503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e604-2d3b-4361-ae75-efa87bd4db5f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.594781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5e604-2d3b-4361-ae75-efa87bd4db5f None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.595492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5e604-2d3b-4361-ae75-efa87bd4db5f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:27.595800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5e604-2d3b-4361-ae75-efa87bd4db5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:27.597221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5e604-2d3b-4361-ae75-efa87bd4db5f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-972bd217-bf92-4668-abff-ec2a87cac137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:27.602118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:27.603237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:27.604160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:27.604160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:27.604160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:27.604160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:27.604474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 459/920] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:27.604474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f506070-ed7e-4a08-8ee6-b25f308c2b11 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.604474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f506070-ed7e-4a08-8ee6-b25f308c2b11 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.604474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f506070-ed7e-4a08-8ee6-b25f308c2b11 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.605181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 460/921] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:27.606869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 462/922] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:27.611533 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f506070-ed7e-4a08-8ee6-b25f308c2b11 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:27.612241 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9342fb-b629-4539-9cd3-97930f7e6750 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.612670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9342fb-b629-4539-9cd3-97930f7e6750 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.613163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9342fb-b629-4539-9cd3-97930f7e6750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.631367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-af9342fb-b629-4539-9cd3-97930f7e6750 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:27.632609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-af9342fb-b629-4539-9cd3-97930f7e6750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:27.675116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:27.703772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 463/923] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:27.704929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9342fb-b629-4539-9cd3-97930f7e6750 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:27.738809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f506070-ed7e-4a08-8ee6-b25f308c2b11 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:27.773591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588b9f2-2b62-4ef8-a34b-07dd880176ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:27.774268 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588b9f2-2b62-4ef8-a34b-07dd880176ce None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.774547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588b9f2-2b62-4ef8-a34b-07dd880176ce None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.774822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588b9f2-2b62-4ef8-a34b-07dd880176ce None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.775532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588b9f2-2b62-4ef8-a34b-07dd880176ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:27.775838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588b9f2-2b62-4ef8-a34b-07dd880176ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:27.777249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588b9f2-2b62-4ef8-a34b-07dd880176ce None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:27.787337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 461/924] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:27.787337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588b9f2-2b62-4ef8-a34b-07dd880176ce None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:27.809945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:27.820444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9342fb-b629-4539-9cd3-97930f7e6750 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:27.854894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb055c-df78-4f4a-aa26-3c164e1ab151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:27.855572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb055c-df78-4f4a-aa26-3c164e1ab151 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.855863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb055c-df78-4f4a-aa26-3c164e1ab151 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.856235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb055c-df78-4f4a-aa26-3c164e1ab151 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.857548 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb055c-df78-4f4a-aa26-3c164e1ab151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:27.857856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb055c-df78-4f4a-aa26-3c164e1ab151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:27.859245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb055c-df78-4f4a-aa26-3c164e1ab151 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:27.870533 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 464/925] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:27.871302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb055c-df78-4f4a-aa26-3c164e1ab151 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:27.895047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588b9f2-2b62-4ef8-a34b-07dd880176ce None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:27.919224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:27.935203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f1c65-5c04-4208-a15a-6922b44170e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:27.936122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1c65-5c04-4208-a15a-6922b44170e2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:27.936415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1c65-5c04-4208-a15a-6922b44170e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:27.936692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1c65-5c04-4208-a15a-6922b44170e2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:27.937345 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f1c65-5c04-4208-a15a-6922b44170e2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:27.938755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f1c65-5c04-4208-a15a-6922b44170e2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b82f1c65-5c04-4208-a15a-6922b44170e2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:27.950575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:27.951572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:27.952410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 462/926] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:16:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:27.953185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f1c65-5c04-4208-a15a-6922b44170e2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:27.987909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb055c-df78-4f4a-aa26-3c164e1ab151 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:28.023279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742e565-3a90-4071-8f52-58a4fc87cb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:28.023949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742e565-3a90-4071-8f52-58a4fc87cb07 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:28.024260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742e565-3a90-4071-8f52-58a4fc87cb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:28.024537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742e565-3a90-4071-8f52-58a4fc87cb07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:28.025296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742e565-3a90-4071-8f52-58a4fc87cb07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:28.026686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742e565-3a90-4071-8f52-58a4fc87cb07 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:28.048955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 465/927] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 4 18:16:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:28.050075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742e565-3a90-4071-8f52-58a4fc87cb07 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:28.065083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f1c65-5c04-4208-a15a-6922b44170e2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:28.068271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:28.118799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43fdf-0ea3-47dc-a7cf-64bae3d7c216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:28.119688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43fdf-0ea3-47dc-a7cf-64bae3d7c216 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:28.119975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43fdf-0ea3-47dc-a7cf-64bae3d7c216 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:28.120276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43fdf-0ea3-47dc-a7cf-64bae3d7c216 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:28.129472 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43fdf-0ea3-47dc-a7cf-64bae3d7c216 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:28.131033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43fdf-0ea3-47dc-a7cf-64bae3d7c216 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7bb43fdf-0ea3-47dc-a7cf-64bae3d7c216 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:28.147981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:28.148998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:28.150350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 463/928] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 4 18:16:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:28.157097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43fdf-0ea3-47dc-a7cf-64bae3d7c216 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:28.197527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742e565-3a90-4071-8f52-58a4fc87cb07 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:28.210967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:28.236537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ded1f-4d5f-4aa0-8c2d-38348344cd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:28.237546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ded1f-4d5f-4aa0-8c2d-38348344cd4f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:28.237976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ded1f-4d5f-4aa0-8c2d-38348344cd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:28.238395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ded1f-4d5f-4aa0-8c2d-38348344cd4f None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:28.239284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ded1f-4d5f-4aa0-8c2d-38348344cd4f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:28.239777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ded1f-4d5f-4aa0-8c2d-38348344cd4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:28.241389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ded1f-4d5f-4aa0-8c2d-38348344cd4f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:28.247350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 466/929] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:16:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:28.253852 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ded1f-4d5f-4aa0-8c2d-38348344cd4f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:28.277561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43fdf-0ea3-47dc-a7cf-64bae3d7c216 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:28.318569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f234c-c7d0-476c-aa10-1fccda766c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:28.319353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f234c-c7d0-476c-aa10-1fccda766c59 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:28.319542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f234c-c7d0-476c-aa10-1fccda766c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:28.319810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f234c-c7d0-476c-aa10-1fccda766c59 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:28.320685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f234c-c7d0-476c-aa10-1fccda766c59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:28.320991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f234c-c7d0-476c-aa10-1fccda766c59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:28.322455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f234c-c7d0-476c-aa10-1fccda766c59 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:28.339249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:28.344633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 464/930] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 4 18:16:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:28.350193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f234c-c7d0-476c-aa10-1fccda766c59 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:28.375877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ded1f-4d5f-4aa0-8c2d-38348344cd4f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:28.412362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6adebc-5a08-481a-bb9a-19a0ed898670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:28.413165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6adebc-5a08-481a-bb9a-19a0ed898670 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:28.413517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6adebc-5a08-481a-bb9a-19a0ed898670 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:28.413862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6adebc-5a08-481a-bb9a-19a0ed898670 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:28.414647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6adebc-5a08-481a-bb9a-19a0ed898670 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:28.415021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6adebc-5a08-481a-bb9a-19a0ed898670 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:28.416513 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6adebc-5a08-481a-bb9a-19a0ed898670 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:28.422656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 467/931] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Jun 4 18:16:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:28.428325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6adebc-5a08-481a-bb9a-19a0ed898670 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:28.477351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:28.482227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f234c-c7d0-476c-aa10-1fccda766c59 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:28.535591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579bf18-c36c-47b7-9ce2-f0747af0680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:28.537036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579bf18-c36c-47b7-9ce2-f0747af0680a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:28.537521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579bf18-c36c-47b7-9ce2-f0747af0680a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:28.538208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579bf18-c36c-47b7-9ce2-f0747af0680a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:28.553743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579bf18-c36c-47b7-9ce2-f0747af0680a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:28.555696 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579bf18-c36c-47b7-9ce2-f0747af0680a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:28.559919 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6adebc-5a08-481a-bb9a-19a0ed898670 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5579bf18-c36c-47b7-9ce2-f0747af0680a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:28.580239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:28.581349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:28.582526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:28.582526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:28.582526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:28.582526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:28.585143 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 465/932] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:28.590157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579bf18-c36c-47b7-9ce2-f0747af0680a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:28.603052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267967ee-335c-4463-9783-d86c7c13b727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:28.604430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267967ee-335c-4463-9783-d86c7c13b727 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:28.604936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267967ee-335c-4463-9783-d86c7c13b727 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:28.605424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267967ee-335c-4463-9783-d86c7c13b727 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:28.606383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267967ee-335c-4463-9783-d86c7c13b727 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:28.608070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267967ee-335c-4463-9783-d86c7c13b727 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:28.612962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:28.637409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 468/933] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 4 18:16:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:16:28.726564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579bf18-c36c-47b7-9ce2-f0747af0680a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:28.773710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698530d-350d-47d0-acfa-33f1acdaa5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:28.774307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698530d-350d-47d0-acfa-33f1acdaa5fb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:28.774590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698530d-350d-47d0-acfa-33f1acdaa5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:28.774868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698530d-350d-47d0-acfa-33f1acdaa5fb None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:28.775676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698530d-350d-47d0-acfa-33f1acdaa5fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:28.775989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698530d-350d-47d0-acfa-33f1acdaa5fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:28.777482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698530d-350d-47d0-acfa-33f1acdaa5fb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:28.791804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 466/934] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:28.797625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267967ee-335c-4463-9783-d86c7c13b727 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:28.911964 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267967ee-335c-4463-9783-d86c7c13b727 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:28.948624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2f788-f2dc-4d36-9460-7db5b42a9d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:28.949435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2f788-f2dc-4d36-9460-7db5b42a9d29 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:28.949712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2f788-f2dc-4d36-9460-7db5b42a9d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:28.949986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2f788-f2dc-4d36-9460-7db5b42a9d29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:28.957550 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2f788-f2dc-4d36-9460-7db5b42a9d29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:28.959037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2f788-f2dc-4d36-9460-7db5b42a9d29 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4ae2f788-f2dc-4d36-9460-7db5b42a9d29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:28.974115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:28.975099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:28.975989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:28.975989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:28.975989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:28.975989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:28.975989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:28.975989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:28.975989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:28.975989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:28.975989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 469/935] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:28.982037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698530d-350d-47d0-acfa-33f1acdaa5fb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:28.993182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:29.091813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698530d-350d-47d0-acfa-33f1acdaa5fb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:29.126690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5698d9-a1fa-4284-8b89-f3c06afd91fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:29.127362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5698d9-a1fa-4284-8b89-f3c06afd91fe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:29.127642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5698d9-a1fa-4284-8b89-f3c06afd91fe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:29.127920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5698d9-a1fa-4284-8b89-f3c06afd91fe None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:29.128755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5698d9-a1fa-4284-8b89-f3c06afd91fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:29.129066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5698d9-a1fa-4284-8b89-f3c06afd91fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:29.130505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5698d9-a1fa-4284-8b89-f3c06afd91fe None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:29.143651 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 467/936] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:29.153308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2f788-f2dc-4d36-9460-7db5b42a9d29 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:29.211796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:29.263727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2f788-f2dc-4d36-9460-7db5b42a9d29 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:29.299549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af752f63-ce77-4745-b884-95e43c3feac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:29.300491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af752f63-ce77-4745-b884-95e43c3feac0 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:29.300772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af752f63-ce77-4745-b884-95e43c3feac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:29.301058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af752f63-ce77-4745-b884-95e43c3feac0 None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/733086955e19437e845f4f77c1178116/roles/1cd3a93991ad4a08a7fbdc65ace3e21e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:29.303321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af752f63-ce77-4745-b884-95e43c3feac0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=733086955e19437e845f4f77c1178116, role_id=1cd3a93991ad4a08a7fbdc65ace3e21e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:29.304938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af752f63-ce77-4745-b884-95e43c3feac0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:29.321777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 470/937] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:16:29 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/733086955e19437e845f4f77c1178116/roles/1cd3a93991ad4a08a7fbdc65ace3e21e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:16:29.338242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4d5c0-16a1-48fc-87ff-8ac985e212c0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:29.338921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4d5c0-16a1-48fc-87ff-8ac985e212c0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:29.339426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4d5c0-16a1-48fc-87ff-8ac985e212c0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:29.341499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 468/938] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:29.347932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d4154-4261-46f4-8a53-a7140d0c128b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:29.348600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d4154-4261-46f4-8a53-a7140d0c128b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:29.349103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d4154-4261-46f4-8a53-a7140d0c128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:29.371727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e57d4154-4261-46f4-8a53-a7140d0c128b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:29.376811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e57d4154-4261-46f4-8a53-a7140d0c128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:29.459514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 471/939] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:29.482702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4d5c0-16a1-48fc-87ff-8ac985e212c0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:29.559870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:29.597673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4d5c0-16a1-48fc-87ff-8ac985e212c0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:29.633458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7288d-b7b1-4dfc-87a7-ed77d84fe5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:29.634652 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7288d-b7b1-4dfc-87a7-ed77d84fe5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:29.635179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7288d-b7b1-4dfc-87a7-ed77d84fe5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:29.635659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7288d-b7b1-4dfc-87a7-ed77d84fe5d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:29.636552 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7288d-b7b1-4dfc-87a7-ed77d84fe5d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:29.638183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7288d-b7b1-4dfc-87a7-ed77d84fe5d6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3df7288d-b7b1-4dfc-87a7-ed77d84fe5d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:29.650519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:29.651565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:29.652441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:29.655491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 469/940] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:29.662148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d4154-4261-46f4-8a53-a7140d0c128b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:29.708355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:29.765816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d4154-4261-46f4-8a53-a7140d0c128b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:29.801857 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7cc1c-6796-4f14-bceb-dd3f5cc0011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:29.802920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7cc1c-6796-4f14-bceb-dd3f5cc0011e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:29.803406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7cc1c-6796-4f14-bceb-dd3f5cc0011e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:29.803897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7cc1c-6796-4f14-bceb-dd3f5cc0011e None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:29.804933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7cc1c-6796-4f14-bceb-dd3f5cc0011e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:29.805455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7cc1c-6796-4f14-bceb-dd3f5cc0011e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:29.807055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7cc1c-6796-4f14-bceb-dd3f5cc0011e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:29.812844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 472/941] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 4 18:16:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:29.818894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7288d-b7b1-4dfc-87a7-ed77d84fe5d6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:29.926688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7288d-b7b1-4dfc-87a7-ed77d84fe5d6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:29.962823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:29.970262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc06ef-40b3-4c39-a0db-35dfa0ffc304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:29.971222 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc06ef-40b3-4c39-a0db-35dfa0ffc304 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:29.971725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc06ef-40b3-4c39-a0db-35dfa0ffc304 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:29.972251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc06ef-40b3-4c39-a0db-35dfa0ffc304 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:29.973164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc06ef-40b3-4c39-a0db-35dfa0ffc304 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:29.973695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc06ef-40b3-4c39-a0db-35dfa0ffc304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:29.975291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc06ef-40b3-4c39-a0db-35dfa0ffc304 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:29.985809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 470/942] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 4 18:16:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:29.987527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7cc1c-6796-4f14-bceb-dd3f5cc0011e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:30.091739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7cc1c-6796-4f14-bceb-dd3f5cc0011e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:30.100201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:30.128646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e848c0-bd87-4750-a45d-02ec2173dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:30.129330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e848c0-bd87-4750-a45d-02ec2173dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:30.129615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e848c0-bd87-4750-a45d-02ec2173dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:30.129892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e848c0-bd87-4750-a45d-02ec2173dbe5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:30.130704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e848c0-bd87-4750-a45d-02ec2173dbe5 None admin] RBAC: Adding query filter params (interface=public, service_id=b504555a4bca44b9a0f0825ff2c94dfb, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:30.131019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e848c0-bd87-4750-a45d-02ec2173dbe5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:30.132447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e848c0-bd87-4750-a45d-02ec2173dbe5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:30.138343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 473/943] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 4 18:16:29 2022] GET /identity/v3/endpoints?service_id=b504555a4bca44b9a0f0825ff2c94dfb&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:30.144080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc06ef-40b3-4c39-a0db-35dfa0ffc304 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:30.254456 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc06ef-40b3-4c39-a0db-35dfa0ffc304 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:30.289590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865d746-e47c-44b5-9e86-79bde9615e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:30.290305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d746-e47c-44b5-9e86-79bde9615e76 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:30.290594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d746-e47c-44b5-9e86-79bde9615e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:30.290873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d746-e47c-44b5-9e86-79bde9615e76 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:30.291566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865d746-e47c-44b5-9e86-79bde9615e76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:30.293321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865d746-e47c-44b5-9e86-79bde9615e76 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:30.300063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 471/944] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 4 18:16:30 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:16:30.509885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67bfb0-bb1f-4323-87ac-e931efc5e93a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:30.510092 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67bfb0-bb1f-4323-87ac-e931efc5e93a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:30.510360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67bfb0-bb1f-4323-87ac-e931efc5e93a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:30.511800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 474/945] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:16:30.518287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80750115-9c98-4a00-b811-0c15f70fcb54 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:30.518600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80750115-9c98-4a00-b811-0c15f70fcb54 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:30.518846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80750115-9c98-4a00-b811-0c15f70fcb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:30.536921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-80750115-9c98-4a00-b811-0c15f70fcb54 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:30.538130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-80750115-9c98-4a00-b811-0c15f70fcb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:30.596334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:30.612763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 472/946] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:30.635560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67bfb0-bb1f-4323-87ac-e931efc5e93a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:30.747772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67bfb0-bb1f-4323-87ac-e931efc5e93a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:30.783162 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fd667-13d1-4f77-ab76-4cd74aae2451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:30.784374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fd667-13d1-4f77-ab76-4cd74aae2451 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:30.784866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fd667-13d1-4f77-ab76-4cd74aae2451 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:30.785331 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fd667-13d1-4f77-ab76-4cd74aae2451 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:30.786206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fd667-13d1-4f77-ab76-4cd74aae2451 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:30.787835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fd667-13d1-4f77-ab76-4cd74aae2451 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-578fd667-13d1-4f77-ab76-4cd74aae2451 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:30.801710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:30.802772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 18:16:30.803595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:30.806737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 475/947] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:30.813617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80750115-9c98-4a00-b811-0c15f70fcb54 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:30.921449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80750115-9c98-4a00-b811-0c15f70fcb54 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:30.956788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f82061-652a-4bd8-9ab9-9f1b1226f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:30.957850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f82061-652a-4bd8-9ab9-9f1b1226f078 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:30.958325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f82061-652a-4bd8-9ab9-9f1b1226f078 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:30.958787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f82061-652a-4bd8-9ab9-9f1b1226f078 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:30.959687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f82061-652a-4bd8-9ab9-9f1b1226f078 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:30.960225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f82061-652a-4bd8-9ab9-9f1b1226f078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:30.961829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f82061-652a-4bd8-9ab9-9f1b1226f078 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:30.967448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 473/948] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:30.973314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fd667-13d1-4f77-ab76-4cd74aae2451 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:31.008751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:31.080588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fd667-13d1-4f77-ab76-4cd74aae2451 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:31.121683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb02b-4ec8-4795-9f16-4c98315f5b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:31.122412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb02b-4ec8-4795-9f16-4c98315f5b34 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:31.122695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb02b-4ec8-4795-9f16-4c98315f5b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:31.123149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb02b-4ec8-4795-9f16-4c98315f5b34 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:31.123887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeb02b-4ec8-4795-9f16-4c98315f5b34 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:31.124231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeb02b-4ec8-4795-9f16-4c98315f5b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:31.125632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeb02b-4ec8-4795-9f16-4c98315f5b34 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:31.130942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 476/949] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:31.160476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cefc3c-3706-4efc-bad9-32e71f7e43be None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:31.161116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cefc3c-3706-4efc-bad9-32e71f7e43be None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:31.161608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cefc3c-3706-4efc-bad9-32e71f7e43be None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:31.163626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 474/950] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:31.170357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2ffe2-6ae6-4a8c-8284-2251d889934e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:31.170674 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2ffe2-6ae6-4a8c-8284-2251d889934e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:31.170931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2ffe2-6ae6-4a8c-8284-2251d889934e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:31.189855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-21e2ffe2-6ae6-4a8c-8284-2251d889934e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:31.191113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-21e2ffe2-6ae6-4a8c-8284-2251d889934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:31.279602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 477/951] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:31.310318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cefc3c-3706-4efc-bad9-32e71f7e43be None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:31.377523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:31.432664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cefc3c-3706-4efc-bad9-32e71f7e43be None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:31.467360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:31.468047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:31.468331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:31.468599 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:31.469302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:31.470774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:31.472183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: WARNING keystone.server.flask.common [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 04 18:16:31.491129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.sql.core [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 18:16:31.491129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 18:16:31.491129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [parameters: {'id': '3ffd3a2778b44fb483c1840239ff2ce7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 04 18:16:31.491129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80214) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ffd3a2778b44fb483c1840239ff2ce7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ffd3a2778b44fb483c1840239ff2ce7. Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 18:16:31.500217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 04 18:16:31.501134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application yield resource Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise self.value Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application session.commit() Jun 04 18:16:31.502070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.flush() Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application compat.raise_( Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 18:16:31.502940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 18:16:31.503821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 18:16:31.504632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [parameters: {'id': '3ffd3a2778b44fb483c1840239ff2ce7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:31.505478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:31.506258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:31.508811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:31.508811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 04 18:16:31.508811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 04 18:16:31.508811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:31.508811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:31.508811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 04 18:16:31.508811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 04 18:16:31.508811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ffd3a2778b44fb483c1840239ff2ce7. Jun 04 18:16:31.508811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:31.508811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 475/952] 10.222.0.39 () {60 vars in 1140 bytes} [Sat Jun 4 18:16:31 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:31.510239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2ffe2-6ae6-4a8c-8284-2251d889934e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:31.538359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:31.617434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2ffe2-6ae6-4a8c-8284-2251d889934e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:31.652392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f686d-7c92-4ff8-88af-384caf253464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:31.653108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f686d-7c92-4ff8-88af-384caf253464 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:31.653420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f686d-7c92-4ff8-88af-384caf253464 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:31.653698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f686d-7c92-4ff8-88af-384caf253464 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:31.660870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f686d-7c92-4ff8-88af-384caf253464 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:31.662337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f686d-7c92-4ff8-88af-384caf253464 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-145f686d-7c92-4ff8-88af-384caf253464 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:31.677318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:31.679392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:31.681509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:31.681509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:31.681509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:31.681509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:31.681509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:31.681509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:31.681509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:31.681509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:31.688048 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 478/953] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:31.688264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:31.736919 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6345b5-cf77-4203-af68-f0fc5ccbdd7b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:31.737273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6345b5-cf77-4203-af68-f0fc5ccbdd7b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:31.737453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6345b5-cf77-4203-af68-f0fc5ccbdd7b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:31.739150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 479/954] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:16:31.744642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170746-6274-42c2-8489-99dcaa69f761 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:31.745267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170746-6274-42c2-8489-99dcaa69f761 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:31.745670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170746-6274-42c2-8489-99dcaa69f761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:31.767527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c2170746-6274-42c2-8489-99dcaa69f761 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:31.768884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c2170746-6274-42c2-8489-99dcaa69f761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:31.808324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c778e-8437-46b3-b50c-01e2cb5ea44f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:31.818649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:31.847401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90083530-cb19-457e-80c4-49a890e74067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:31.848367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90083530-cb19-457e-80c4-49a890e74067 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:31.848789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90083530-cb19-457e-80c4-49a890e74067 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:31.856032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90083530-cb19-457e-80c4-49a890e74067 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:31.856195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 480/955] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:31.856279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90083530-cb19-457e-80c4-49a890e74067 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:31.856279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90083530-cb19-457e-80c4-49a890e74067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:31.856279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90083530-cb19-457e-80c4-49a890e74067 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:31.875466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170746-6274-42c2-8489-99dcaa69f761 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:31.876355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 476/956] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:31.900799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:31.992644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170746-6274-42c2-8489-99dcaa69f761 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:32.032339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1504f-ffe0-4f96-b872-63e28b2fc68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:32.033191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1504f-ffe0-4f96-b872-63e28b2fc68a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:32.033478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1504f-ffe0-4f96-b872-63e28b2fc68a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:32.033757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1504f-ffe0-4f96-b872-63e28b2fc68a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:32.046661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1504f-ffe0-4f96-b872-63e28b2fc68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-74f1504f-ffe0-4f96-b872-63e28b2fc68a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:32.055052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:32.056045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:32.056910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 481/957] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 4 18:16:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:32.065550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90083530-cb19-457e-80c4-49a890e74067 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:32.178009 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90083530-cb19-457e-80c4-49a890e74067 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:32.213641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7ce7e-c493-4643-bce5-a090b98a1ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:32.214721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7ce7e-c493-4643-bce5-a090b98a1ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:32.215207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7ce7e-c493-4643-bce5-a090b98a1ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:32.215679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7ce7e-c493-4643-bce5-a090b98a1ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:32.217543 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7ce7e-c493-4643-bce5-a090b98a1ea4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:32.218083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7ce7e-c493-4643-bce5-a090b98a1ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:32.219668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7ce7e-c493-4643-bce5-a090b98a1ea4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:32.228980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 477/958] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 4 18:16:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:32.235686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1504f-ffe0-4f96-b872-63e28b2fc68a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:32.318248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:32.343767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1504f-ffe0-4f96-b872-63e28b2fc68a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:32.386411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80d7dd-1dbf-4bf6-8299-3f35693ac840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:32.387231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80d7dd-1dbf-4bf6-8299-3f35693ac840 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:32.387512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80d7dd-1dbf-4bf6-8299-3f35693ac840 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:32.388215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80d7dd-1dbf-4bf6-8299-3f35693ac840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:32.400809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80d7dd-1dbf-4bf6-8299-3f35693ac840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:32.402339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80d7dd-1dbf-4bf6-8299-3f35693ac840 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-bc80d7dd-1dbf-4bf6-8299-3f35693ac840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:32.423546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:32.424580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:32.425515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:32.425515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:32.425515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:32.425515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:32.425515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 482/959] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:32.431072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7ce7e-c493-4643-bce5-a090b98a1ea4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:32.470002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:32.549569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7ce7e-c493-4643-bce5-a090b98a1ea4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:32.584757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1189172-7dfa-45dd-b7db-5e09d090dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:32.585350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1189172-7dfa-45dd-b7db-5e09d090dff8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:32.585628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1189172-7dfa-45dd-b7db-5e09d090dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:32.585904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1189172-7dfa-45dd-b7db-5e09d090dff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:32.586628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1189172-7dfa-45dd-b7db-5e09d090dff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:32.586934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1189172-7dfa-45dd-b7db-5e09d090dff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:32.588335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1189172-7dfa-45dd-b7db-5e09d090dff8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:32.601163 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 478/960] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:32.606521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80d7dd-1dbf-4bf6-8299-3f35693ac840 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:32.712544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80d7dd-1dbf-4bf6-8299-3f35693ac840 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:32.741665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:32.748039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1c57-210a-489a-b559-939dc22873d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:32.748919 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1c57-210a-489a-b559-939dc22873d8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:32.749301 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1c57-210a-489a-b559-939dc22873d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:32.749584 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf1c57-210a-489a-b559-939dc22873d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:32.758241 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf1c57-210a-489a-b559-939dc22873d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:32.760167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf1c57-210a-489a-b559-939dc22873d8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:32.771765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10511-3738-4297-9e69-1b939dbfac90 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:32.772081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10511-3738-4297-9e69-1b939dbfac90 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:32.772358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10511-3738-4297-9e69-1b939dbfac90 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:32.773862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 479/961] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-09cf1c57-210a-489a-b559-939dc22873d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:32.775993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:32.777243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:32.778166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 483/962] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 4 18:16:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:32.783355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e1a02-a216-4883-9da4-c889c5aa072c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:32.783648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e1a02-a216-4883-9da4-c889c5aa072c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:32.783927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e1a02-a216-4883-9da4-c889c5aa072c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:32.786308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1c57-210a-489a-b559-939dc22873d8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:32.806395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-eb1e1a02-a216-4883-9da4-c889c5aa072c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:32.808275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eb1e1a02-a216-4883-9da4-c889c5aa072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:32.893895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf1c57-210a-489a-b559-939dc22873d8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:32.898106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 480/963] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:32.923466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e1a02-a216-4883-9da4-c889c5aa072c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:32.933251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb0900-57fd-40e4-8bc7-ddfdc16bf057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:32.933949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb0900-57fd-40e4-8bc7-ddfdc16bf057 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:32.934228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb0900-57fd-40e4-8bc7-ddfdc16bf057 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:32.934510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb0900-57fd-40e4-8bc7-ddfdc16bf057 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:32.935482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb0900-57fd-40e4-8bc7-ddfdc16bf057 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:32.935802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb0900-57fd-40e4-8bc7-ddfdc16bf057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:32.937322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb0900-57fd-40e4-8bc7-ddfdc16bf057 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:32.947034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:32.960506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 484/964] 10.222.0.39 () {56 vars in 1149 bytes} [Sat Jun 4 18:16:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:32.961896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb0900-57fd-40e4-8bc7-ddfdc16bf057 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:33.027314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:33.060208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e1a02-a216-4883-9da4-c889c5aa072c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:33.099417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adbba0-daf0-416f-9001-d8d3914f3c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:33.101077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adbba0-daf0-416f-9001-d8d3914f3c02 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.101581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adbba0-daf0-416f-9001-d8d3914f3c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.102060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adbba0-daf0-416f-9001-d8d3914f3c02 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.102923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adbba0-daf0-416f-9001-d8d3914f3c02 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:33.104545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adbba0-daf0-416f-9001-d8d3914f3c02 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:33.107575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb0900-57fd-40e4-8bc7-ddfdc16bf057 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-42adbba0-daf0-416f-9001-d8d3914f3c02 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:33.117973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:33.119022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:33.119864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:33.127581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 481/965] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:33.128845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adbba0-daf0-416f-9001-d8d3914f3c02 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:33.151375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04227d78-7706-4ec9-bcc4-4156ccaaabdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:33.151997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227d78-7706-4ec9-bcc4-4156ccaaabdc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.152311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227d78-7706-4ec9-bcc4-4156ccaaabdc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.152589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227d78-7706-4ec9-bcc4-4156ccaaabdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.236499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:33.248605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04227d78-7706-4ec9-bcc4-4156ccaaabdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:33.250180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04227d78-7706-4ec9-bcc4-4156ccaaabdc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:33.254517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adbba0-daf0-416f-9001-d8d3914f3c02 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:33.289901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd81c0d-cb84-4ad0-90d7-89e100619f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:33.290869 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd81c0d-cb84-4ad0-90d7-89e100619f5b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.291318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd81c0d-cb84-4ad0-90d7-89e100619f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.291732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd81c0d-cb84-4ad0-90d7-89e100619f5b None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.293090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd81c0d-cb84-4ad0-90d7-89e100619f5b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:33.293542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd81c0d-cb84-4ad0-90d7-89e100619f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:33.295427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd81c0d-cb84-4ad0-90d7-89e100619f5b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:33.301026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:33.302954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 482/966] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 4 18:16:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:33.311183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd81c0d-cb84-4ad0-90d7-89e100619f5b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:33.356733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 485/967] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:32 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 18:16:33.361795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04227d78-7706-4ec9-bcc4-4156ccaaabdc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:33.419401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd81c0d-cb84-4ad0-90d7-89e100619f5b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:33.456625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a89b7-68b3-4536-8fdb-19369245a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:33.457776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a89b7-68b3-4536-8fdb-19369245a0fa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.458272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a89b7-68b3-4536-8fdb-19369245a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.458797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a89b7-68b3-4536-8fdb-19369245a0fa None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.459706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a89b7-68b3-4536-8fdb-19369245a0fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:33.460254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a89b7-68b3-4536-8fdb-19369245a0fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:33.462009 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a89b7-68b3-4536-8fdb-19369245a0fa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:33.464439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04227d78-7706-4ec9-bcc4-4156ccaaabdc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:33.468321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 483/968] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 4 18:16:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:33.476114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a89b7-68b3-4536-8fdb-19369245a0fa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:33.494594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:33.502947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f8493-6aac-42ff-9fb6-d0a34dcd5e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:33.503757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f8493-6aac-42ff-9fb6-d0a34dcd5e44 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.504064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f8493-6aac-42ff-9fb6-d0a34dcd5e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.504345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f8493-6aac-42ff-9fb6-d0a34dcd5e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.515360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f8493-6aac-42ff-9fb6-d0a34dcd5e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:33.517015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f8493-6aac-42ff-9fb6-d0a34dcd5e44 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:33.527051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-236f8493-6aac-42ff-9fb6-d0a34dcd5e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:33.537258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:33.538345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:33.539442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:33.539442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:33.539442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:33.539442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:33.541161 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 486/969] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:33.547625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ff066-9dd7-4592-a133-ec23610bf5de None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.547899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ff066-9dd7-4592-a133-ec23610bf5de None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.548209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ff066-9dd7-4592-a133-ec23610bf5de None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.549486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 487/970] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:33.550160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ff066-9dd7-4592-a133-ec23610bf5de None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:33.594890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a89b7-68b3-4536-8fdb-19369245a0fa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:33.630598 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479d894-11b6-47e1-b084-cfcf9947a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:33.631349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479d894-11b6-47e1-b084-cfcf9947a197 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.631638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479d894-11b6-47e1-b084-cfcf9947a197 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.631913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479d894-11b6-47e1-b084-cfcf9947a197 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.632735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479d894-11b6-47e1-b084-cfcf9947a197 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:33.634125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479d894-11b6-47e1-b084-cfcf9947a197 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:33.656753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 484/971] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 4 18:16:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:33.662239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e13a9-0a2a-43f5-85a0-8144e39bc0af None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.662945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e13a9-0a2a-43f5-85a0-8144e39bc0af None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.663161 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ff066-9dd7-4592-a133-ec23610bf5de None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:33.663689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e13a9-0a2a-43f5-85a0-8144e39bc0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.689822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ce9e13a9-0a2a-43f5-85a0-8144e39bc0af None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:33.692025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ce9e13a9-0a2a-43f5-85a0-8144e39bc0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:33.706061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eab2c1-7db9-40be-9ba9-1d432c1ca312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:33.706605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eab2c1-7db9-40be-9ba9-1d432c1ca312 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.706891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eab2c1-7db9-40be-9ba9-1d432c1ca312 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.707168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eab2c1-7db9-40be-9ba9-1d432c1ca312 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.707915 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eab2c1-7db9-40be-9ba9-1d432c1ca312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:33.708254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eab2c1-7db9-40be-9ba9-1d432c1ca312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:33.710014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eab2c1-7db9-40be-9ba9-1d432c1ca312 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:33.727768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 488/972] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:33.729075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eab2c1-7db9-40be-9ba9-1d432c1ca312 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:33.778172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:33.785063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 485/973] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:33.804506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:33.812319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e13a9-0a2a-43f5-85a0-8144e39bc0af None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:33.856671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eab2c1-7db9-40be-9ba9-1d432c1ca312 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:33.896393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5f886-46ab-4834-9f68-a5f89d257698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:33.897357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5f886-46ab-4834-9f68-a5f89d257698 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.897474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5f886-46ab-4834-9f68-a5f89d257698 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.897751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5f886-46ab-4834-9f68-a5f89d257698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.906836 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5f886-46ab-4834-9f68-a5f89d257698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:33.908366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5f886-46ab-4834-9f68-a5f89d257698 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:33.925212 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e13a9-0a2a-43f5-85a0-8144e39bc0af None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3ba5f886-46ab-4834-9f68-a5f89d257698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:33.925432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:33.926237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:33.927112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:33.927112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:33.927112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:33.927112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:33.927112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:33.927112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:33.927112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:33.927112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:33.927112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 489/974] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:33.932199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5f886-46ab-4834-9f68-a5f89d257698 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:33.983878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949831e2-ed30-4ad4-bc84-d64f2f57fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:33.985319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949831e2-ed30-4ad4-bc84-d64f2f57fe42 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:33.985846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949831e2-ed30-4ad4-bc84-d64f2f57fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:33.986670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949831e2-ed30-4ad4-bc84-d64f2f57fe42 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:33.987945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949831e2-ed30-4ad4-bc84-d64f2f57fe42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:33.990283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949831e2-ed30-4ad4-bc84-d64f2f57fe42 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:34.011919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 486/975] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:16:33 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:34.060241 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5f886-46ab-4834-9f68-a5f89d257698 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:34.080450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:34.108583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2caee3b-b3b2-4a9b-99ea-ce338954171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:34.109742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caee3b-b3b2-4a9b-99ea-ce338954171e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:34.110390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caee3b-b3b2-4a9b-99ea-ce338954171e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:34.110734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caee3b-b3b2-4a9b-99ea-ce338954171e None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:34.111619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2caee3b-b3b2-4a9b-99ea-ce338954171e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:34.112406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2caee3b-b3b2-4a9b-99ea-ce338954171e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:34.114045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2caee3b-b3b2-4a9b-99ea-ce338954171e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:34.128344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 490/976] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:34.134647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949831e2-ed30-4ad4-bc84-d64f2f57fe42 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:34.200662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:34.246852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949831e2-ed30-4ad4-bc84-d64f2f57fe42 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:34.287636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583ed8c-f76a-4299-89c0-cece9080a5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:34.288430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583ed8c-f76a-4299-89c0-cece9080a5be None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:34.288779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583ed8c-f76a-4299-89c0-cece9080a5be None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:34.289120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583ed8c-f76a-4299-89c0-cece9080a5be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:34.290034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583ed8c-f76a-4299-89c0-cece9080a5be None admin] RBAC: Adding query filter params (role.id=1cd3a93991ad4a08a7fbdc65ace3e21e, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=733086955e19437e845f4f77c1178116) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:34.290413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583ed8c-f76a-4299-89c0-cece9080a5be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:34.291936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583ed8c-f76a-4299-89c0-cece9080a5be None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:34.299934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 487/977] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:34 2022] GET /identity/v3/role_assignments?user.id=733086955e19437e845f4f77c1178116&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=1cd3a93991ad4a08a7fbdc65ace3e21e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:34.336992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3854b0-c4eb-4031-8e1b-49d824d1d975 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:34.337530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3854b0-c4eb-4031-8e1b-49d824d1d975 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:34.337976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3854b0-c4eb-4031-8e1b-49d824d1d975 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:34.339896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 491/978] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:34.346226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ec647-6f0c-45be-b7f3-1c0d6b2856df None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:34.346750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ec647-6f0c-45be-b7f3-1c0d6b2856df None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:34.347175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ec647-6f0c-45be-b7f3-1c0d6b2856df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:34.365900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b38ec647-6f0c-45be-b7f3-1c0d6b2856df None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:34.367396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b38ec647-6f0c-45be-b7f3-1c0d6b2856df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:34.448145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 488/979] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:34.467619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3854b0-c4eb-4031-8e1b-49d824d1d975 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:34.578150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3854b0-c4eb-4031-8e1b-49d824d1d975 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:34.613827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:34.614789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:34.615347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:34.615770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:34.616662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:34.618363 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:34.619831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WARNING keystone.server.flask.common [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 04 18:16:34.634342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.sql.core [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 18:16:34.634342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 04 18:16:34.634342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [parameters: {'user_id': 'd9286a9a25334f92b64f4696de4cbcb9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 04 18:16:34.634342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80215) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application conn.query(q) Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application result.read() Jun 04 18:16:34.652294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 18:16:34.653442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application next(self.gen) Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application yield resource Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application next(self.gen) Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise self.value Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application session.commit() Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 18:16:34.654682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.session.flush() Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application compat.raise_( Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 18:16:34.655591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 18:16:34.656505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application conn.query(q) Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application result.read() Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 18:16:34.657352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd9286a9a25334f92b64f4696de4cbcb9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:34.658322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 04 18:16:34.659308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 04 18:16:34.660422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 04 18:16:34.660422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 04 18:16:34.660422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 18:16:34.660422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 18:16:34.660422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 04 18:16:34.660422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:34.666256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 492/980] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Jun 4 18:16:34 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:34.669857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ec647-6f0c-45be-b7f3-1c0d6b2856df None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:34.731871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:34.783990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ec647-6f0c-45be-b7f3-1c0d6b2856df None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:34.820470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a80960-c9e7-4a08-b80b-aa93017c839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:34.821333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a80960-c9e7-4a08-b80b-aa93017c839d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:34.821615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a80960-c9e7-4a08-b80b-aa93017c839d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:34.821888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a80960-c9e7-4a08-b80b-aa93017c839d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:34.830542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a80960-c9e7-4a08-b80b-aa93017c839d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:34.831978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a80960-c9e7-4a08-b80b-aa93017c839d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-33a80960-c9e7-4a08-b80b-aa93017c839d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:34.847454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:34.848467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:34.849695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 489/981] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:16:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:34.856563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:34.895970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:34.971898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b15196-38e9-4527-85b7-a69b3262015a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:35.007983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc10ab-07ef-4d6f-923a-0e61c8f8e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:35.009065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc10ab-07ef-4d6f-923a-0e61c8f8e80e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:35.009586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc10ab-07ef-4d6f-923a-0e61c8f8e80e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:35.010058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc10ab-07ef-4d6f-923a-0e61c8f8e80e None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:35.011099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc10ab-07ef-4d6f-923a-0e61c8f8e80e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:35.011711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc10ab-07ef-4d6f-923a-0e61c8f8e80e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:35.013624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc10ab-07ef-4d6f-923a-0e61c8f8e80e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:35.060126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 493/982] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Jun 4 18:16:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:36.024200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba22dde-96c9-4753-a87b-011d7034fdbd None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.024745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba22dde-96c9-4753-a87b-011d7034fdbd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.024745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba22dde-96c9-4753-a87b-011d7034fdbd None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.026170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 490/983] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:36.032737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56d868-2fc7-4565-a732-4f384b0a190c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.033152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56d868-2fc7-4565-a732-4f384b0a190c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.033354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56d868-2fc7-4565-a732-4f384b0a190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.051730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ff56d868-2fc7-4565-a732-4f384b0a190c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:36.053300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ff56d868-2fc7-4565-a732-4f384b0a190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:36.127058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 494/984] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:36.150121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba22dde-96c9-4753-a87b-011d7034fdbd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:36.260541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba22dde-96c9-4753-a87b-011d7034fdbd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:36.275010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:36.312627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8a014-72bc-4ba4-9a6c-9e7204669a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:36.313534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8a014-72bc-4ba4-9a6c-9e7204669a63 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.313824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8a014-72bc-4ba4-9a6c-9e7204669a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.314105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8a014-72bc-4ba4-9a6c-9e7204669a63 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.314761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8a014-72bc-4ba4-9a6c-9e7204669a63 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:36.316247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8a014-72bc-4ba4-9a6c-9e7204669a63 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5be8a014-72bc-4ba4-9a6c-9e7204669a63 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:36.329539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:36.330607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:36.331571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:36.336049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 491/985] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:36.337361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56d868-2fc7-4565-a732-4f384b0a190c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:36.363152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:36.438983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ab64c-918b-4115-895c-fc1f5b9f8ea5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.439327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ab64c-918b-4115-895c-fc1f5b9f8ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.439520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ab64c-918b-4115-895c-fc1f5b9f8ea5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.441115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 492/986] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:16:36.443411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56d868-2fc7-4565-a732-4f384b0a190c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:36.447014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181e39e-ad9b-4fae-bec9-52ba8dd9cd68 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.447302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181e39e-ad9b-4fae-bec9-52ba8dd9cd68 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.447582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181e39e-ad9b-4fae-bec9-52ba8dd9cd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.466328 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8181e39e-ad9b-4fae-bec9-52ba8dd9cd68 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:36.467606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8181e39e-ad9b-4fae-bec9-52ba8dd9cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:36.479517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2cd62-34a5-44d6-950d-4422b54f9141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:36.480216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2cd62-34a5-44d6-950d-4422b54f9141 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.480510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2cd62-34a5-44d6-950d-4422b54f9141 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.480769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2cd62-34a5-44d6-950d-4422b54f9141 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.481578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2cd62-34a5-44d6-950d-4422b54f9141 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:36.481961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2cd62-34a5-44d6-950d-4422b54f9141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:36.483471 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2cd62-34a5-44d6-950d-4422b54f9141 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:36.488626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 495/987] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 4 18:16:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:36.493978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2cd62-34a5-44d6-950d-4422b54f9141 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:36.540247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 493/988] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:36.564288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181e39e-ad9b-4fae-bec9-52ba8dd9cd68 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:36.589311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:36.610442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2cd62-34a5-44d6-950d-4422b54f9141 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:36.647534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938f7cc-c5ca-4bea-bff5-b5064ff09a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:36.648237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938f7cc-c5ca-4bea-bff5-b5064ff09a8e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.648815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938f7cc-c5ca-4bea-bff5-b5064ff09a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.648815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938f7cc-c5ca-4bea-bff5-b5064ff09a8e None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.649503 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938f7cc-c5ca-4bea-bff5-b5064ff09a8e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:36.649810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938f7cc-c5ca-4bea-bff5-b5064ff09a8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:36.651198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938f7cc-c5ca-4bea-bff5-b5064ff09a8e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:36.656313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 496/989] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 4 18:16:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:36.657512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b227f-4f5c-49a2-bb32-6473b8b9b406 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.657799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b227f-4f5c-49a2-bb32-6473b8b9b406 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.658076 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b227f-4f5c-49a2-bb32-6473b8b9b406 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.660337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 497/990] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:36.662195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b227f-4f5c-49a2-bb32-6473b8b9b406 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:36.672218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181e39e-ad9b-4fae-bec9-52ba8dd9cd68 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:36.680160 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:36.707263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af7724-23bf-4e83-ab46-9529521166cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:36.708099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7724-23bf-4e83-ab46-9529521166cf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.708384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7724-23bf-4e83-ab46-9529521166cf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.708658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af7724-23bf-4e83-ab46-9529521166cf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.709312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af7724-23bf-4e83-ab46-9529521166cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:36.710686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af7724-23bf-4e83-ab46-9529521166cf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-57af7724-23bf-4e83-ab46-9529521166cf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:36.723747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:36.724801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:36.725746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 494/991] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:36.726545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eb77b-2013-4a53-9bf7-343a6b1a57b5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.726545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eb77b-2013-4a53-9bf7-343a6b1a57b5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.726683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eb77b-2013-4a53-9bf7-343a6b1a57b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.743388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1a1eb77b-2013-4a53-9bf7-343a6b1a57b5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:36.744592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a1eb77b-2013-4a53-9bf7-343a6b1a57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:36.770032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b227f-4f5c-49a2-bb32-6473b8b9b406 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:36.810310 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8700c-0f30-41bd-b112-33ca8f8849e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:36.810867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8700c-0f30-41bd-b112-33ca8f8849e5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.811148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8700c-0f30-41bd-b112-33ca8f8849e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.811425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8700c-0f30-41bd-b112-33ca8f8849e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.812267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8700c-0f30-41bd-b112-33ca8f8849e5 None admin] RBAC: Adding query filter params (interface=admin, service_id=b504555a4bca44b9a0f0825ff2c94dfb, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:36.812578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8700c-0f30-41bd-b112-33ca8f8849e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:36.813957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8700c-0f30-41bd-b112-33ca8f8849e5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:36.815040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 495/992] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:36.815989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eb77b-2013-4a53-9bf7-343a6b1a57b5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:36.824031 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 498/993] 10.222.0.39 () {56 vars in 1249 bytes} [Sat Jun 4 18:16:36 2022] GET /identity/v3/endpoints?service_id=b504555a4bca44b9a0f0825ff2c94dfb&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:36.825001 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8700c-0f30-41bd-b112-33ca8f8849e5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:36.841056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:36.914332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:36.917288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eb77b-2013-4a53-9bf7-343a6b1a57b5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:36.925773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8700c-0f30-41bd-b112-33ca8f8849e5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:36.951145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988aa72-5371-4d80-99f1-be150a0078f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:36.951814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988aa72-5371-4d80-99f1-be150a0078f1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.952130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988aa72-5371-4d80-99f1-be150a0078f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.952409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988aa72-5371-4d80-99f1-be150a0078f1 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.953122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988aa72-5371-4d80-99f1-be150a0078f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:36.953433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988aa72-5371-4d80-99f1-be150a0078f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:36.954821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988aa72-5371-4d80-99f1-be150a0078f1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:36.958905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75646940-6ffe-4015-a4cf-b8a41f4003a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:36.959528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 496/994] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:36.959616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75646940-6ffe-4015-a4cf-b8a41f4003a1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:36.959835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75646940-6ffe-4015-a4cf-b8a41f4003a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:36.960167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75646940-6ffe-4015-a4cf-b8a41f4003a1 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:36.960339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988aa72-5371-4d80-99f1-be150a0078f1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:36.960850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75646940-6ffe-4015-a4cf-b8a41f4003a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:36.962214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75646940-6ffe-4015-a4cf-b8a41f4003a1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:36.972578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 499/995] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 4 18:16:36 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:16:36.972578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75646940-6ffe-4015-a4cf-b8a41f4003a1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:37.065069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:37.074176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988aa72-5371-4d80-99f1-be150a0078f1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:37.092438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75646940-6ffe-4015-a4cf-b8a41f4003a1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:37.114475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0402f8-49c5-444f-a697-7cd2715cc1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:37.115298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0402f8-49c5-444f-a697-7cd2715cc1dd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:37.115585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0402f8-49c5-444f-a697-7cd2715cc1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:37.115864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0402f8-49c5-444f-a697-7cd2715cc1dd None admin] PATH_INFO: `/v3/services/image` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:37.116574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0402f8-49c5-444f-a697-7cd2715cc1dd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:37.117987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0402f8-49c5-444f-a697-7cd2715cc1dd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ce0402f8-49c5-444f-a697-7cd2715cc1dd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:37.130488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:37.131548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:37.132463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 497/996] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Jun 4 18:16:36 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:37.133881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e14bfa-6384-4d2e-848d-8ad404157e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:37.134675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14bfa-6384-4d2e-848d-8ad404157e3c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:37.134959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14bfa-6384-4d2e-848d-8ad404157e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:37.135234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14bfa-6384-4d2e-848d-8ad404157e3c None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:37.135971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e14bfa-6384-4d2e-848d-8ad404157e3c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:37.136421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e14bfa-6384-4d2e-848d-8ad404157e3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:37.138225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0402f8-49c5-444f-a697-7cd2715cc1dd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:37.138386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e14bfa-6384-4d2e-848d-8ad404157e3c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:37.149065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 500/997] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:37.150312 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e14bfa-6384-4d2e-848d-8ad404157e3c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:37.172720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:37.249348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0402f8-49c5-444f-a697-7cd2715cc1dd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:37.257836 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e14bfa-6384-4d2e-848d-8ad404157e3c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:37.284968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4285-77cf-460c-852e-aa7940eba613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:37.285739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4285-77cf-460c-852e-aa7940eba613 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:37.286259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4285-77cf-460c-852e-aa7940eba613 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:37.286378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4285-77cf-460c-852e-aa7940eba613 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:37.287014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c4285-77cf-460c-852e-aa7940eba613 None admin] RBAC: Adding query filter params (name=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:37.287327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c4285-77cf-460c-852e-aa7940eba613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:37.288740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c4285-77cf-460c-852e-aa7940eba613 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:37.298105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c45fa-1884-4a1d-afc4-51c00320979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:37.298800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 498/998] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:37.299085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c45fa-1884-4a1d-afc4-51c00320979e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:37.299372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c45fa-1884-4a1d-afc4-51c00320979e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:37.299647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c45fa-1884-4a1d-afc4-51c00320979e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:37.299844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4285-77cf-460c-852e-aa7940eba613 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:37.300490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c45fa-1884-4a1d-afc4-51c00320979e None admin] RBAC: Adding query filter params (interface=public, service_id=5f44c1891388434db08a7ba6d119da72, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:37.303654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c45fa-1884-4a1d-afc4-51c00320979e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:37.303654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c45fa-1884-4a1d-afc4-51c00320979e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:37.308327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 501/999] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 4 18:16:37 2022] GET /identity/v3/endpoints?service_id=5f44c1891388434db08a7ba6d119da72&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:37.313995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c45fa-1884-4a1d-afc4-51c00320979e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:37.322698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:37.400050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:37.408871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4285-77cf-460c-852e-aa7940eba613 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:37.420998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c45fa-1884-4a1d-afc4-51c00320979e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:37.444370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbe997-ed8a-45f7-98ca-e4a477c59571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:37.445043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbe997-ed8a-45f7-98ca-e4a477c59571 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:37.445319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbe997-ed8a-45f7-98ca-e4a477c59571 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:37.445592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbe997-ed8a-45f7-98ca-e4a477c59571 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:37.446299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbe997-ed8a-45f7-98ca-e4a477c59571 None admin] RBAC: Adding query filter params (type=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:37.446602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbe997-ed8a-45f7-98ca-e4a477c59571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:37.447989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbe997-ed8a-45f7-98ca-e4a477c59571 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:37.453006 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 499/1000] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:37.467922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc575a0-1ad8-4ebf-9196-52fc1d7bf08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:37.468679 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc575a0-1ad8-4ebf-9196-52fc1d7bf08b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:37.468960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc575a0-1ad8-4ebf-9196-52fc1d7bf08b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:37.469242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc575a0-1ad8-4ebf-9196-52fc1d7bf08b None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:37.469958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc575a0-1ad8-4ebf-9196-52fc1d7bf08b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:37.471401 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc575a0-1ad8-4ebf-9196-52fc1d7bf08b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:37.478814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 502/1001] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 4 18:16:37 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:16:39.259547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481430-32de-4520-93d0-e338179c021e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:39.260099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481430-32de-4520-93d0-e338179c021e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:39.260208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481430-32de-4520-93d0-e338179c021e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:39.261597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 500/1002] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:39.267530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ea0e9-03b8-4af9-882f-c5f04019ee52 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:39.267996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ea0e9-03b8-4af9-882f-c5f04019ee52 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:39.268107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ea0e9-03b8-4af9-882f-c5f04019ee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:39.286970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d69ea0e9-03b8-4af9-882f-c5f04019ee52 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:39.288248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d69ea0e9-03b8-4af9-882f-c5f04019ee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:39.361702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:39.373918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 503/1003] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:39.392798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e481430-32de-4520-93d0-e338179c021e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:39.504169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e481430-32de-4520-93d0-e338179c021e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:39.539020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88aa1f-edf5-4cd2-a96c-45a33d3e4cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:39.539841 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88aa1f-edf5-4cd2-a96c-45a33d3e4cef None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:39.540149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88aa1f-edf5-4cd2-a96c-45a33d3e4cef None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:39.540419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88aa1f-edf5-4cd2-a96c-45a33d3e4cef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:39.541063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88aa1f-edf5-4cd2-a96c-45a33d3e4cef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:39.542788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88aa1f-edf5-4cd2-a96c-45a33d3e4cef None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-db88aa1f-edf5-4cd2-a96c-45a33d3e4cef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:39.554695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:39.555735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 04 18:16:39.557151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:39.560541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 501/1004] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Jun 4 18:16:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:39.562451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ea0e9-03b8-4af9-882f-c5f04019ee52 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:39.672179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ea0e9-03b8-4af9-882f-c5f04019ee52 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:39.709713 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9a6c0-d61a-4b65-8f72-b5c84f51d915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:39.710388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a6c0-d61a-4b65-8f72-b5c84f51d915 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:39.710667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a6c0-d61a-4b65-8f72-b5c84f51d915 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:39.710937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a6c0-d61a-4b65-8f72-b5c84f51d915 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:39.711640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9a6c0-d61a-4b65-8f72-b5c84f51d915 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:39.711943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9a6c0-d61a-4b65-8f72-b5c84f51d915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:39.713355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9a6c0-d61a-4b65-8f72-b5c84f51d915 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:39.716586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884870fe-573e-45e3-ab9e-c81e92049542 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:39.717159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884870fe-573e-45e3-ab9e-c81e92049542 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:39.717692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884870fe-573e-45e3-ab9e-c81e92049542 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:39.719197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 502/1005] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:39.724316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 504/1006] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 4 18:16:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:39.724909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02180c7-48de-423a-babc-dbd00317175b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:39.725262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02180c7-48de-423a-babc-dbd00317175b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:39.725376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9a6c0-d61a-4b65-8f72-b5c84f51d915 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:39.725708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02180c7-48de-423a-babc-dbd00317175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:39.743909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a02180c7-48de-423a-babc-dbd00317175b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:39.745230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a02180c7-48de-423a-babc-dbd00317175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:39.760679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:39.789655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:39.815930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 503/1007] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:39.817276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a490c-1d78-4a56-a853-98da24e4be6e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:39.817560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a490c-1d78-4a56-a853-98da24e4be6e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:39.817836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a490c-1d78-4a56-a853-98da24e4be6e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:39.819220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 504/1008] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:39.824705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763bf43-e8d8-40e3-8f85-b0e957433c97 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:39.825129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763bf43-e8d8-40e3-8f85-b0e957433c97 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:39.825367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763bf43-e8d8-40e3-8f85-b0e957433c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:39.829375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9a6c0-d61a-4b65-8f72-b5c84f51d915 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:39.841720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5763bf43-e8d8-40e3-8f85-b0e957433c97 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:39.842902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5763bf43-e8d8-40e3-8f85-b0e957433c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:39.865581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e49564-bc38-4c3a-b5ab-028a98d0b414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:39.866258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49564-bc38-4c3a-b5ab-028a98d0b414 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:39.866539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49564-bc38-4c3a-b5ab-028a98d0b414 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:39.866814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49564-bc38-4c3a-b5ab-028a98d0b414 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:39.867526 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e49564-bc38-4c3a-b5ab-028a98d0b414 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:39.867862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e49564-bc38-4c3a-b5ab-028a98d0b414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:39.869283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e49564-bc38-4c3a-b5ab-028a98d0b414 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:39.875006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 505/1009] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Jun 4 18:16:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:39.875830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e49564-bc38-4c3a-b5ab-028a98d0b414 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:39.908171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 505/1010] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:39.908971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763bf43-e8d8-40e3-8f85-b0e957433c97 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:39.980918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e49564-bc38-4c3a-b5ab-028a98d0b414 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:39.989116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:40.006432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:40.009004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763bf43-e8d8-40e3-8f85-b0e957433c97 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:40.014645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fa583-9e9d-4bb1-a1e9-7aa2168c7547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:40.015318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fa583-9e9d-4bb1-a1e9-7aa2168c7547 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:40.015618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fa583-9e9d-4bb1-a1e9-7aa2168c7547 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:40.015923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fa583-9e9d-4bb1-a1e9-7aa2168c7547 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:40.016701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fa583-9e9d-4bb1-a1e9-7aa2168c7547 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:40.018216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fa583-9e9d-4bb1-a1e9-7aa2168c7547 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:40.033049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 506/1011] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:16:39 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:40.033868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fa583-9e9d-4bb1-a1e9-7aa2168c7547 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:40.057693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39728d-5b11-4ff1-9bf3-bdadf3643ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:40.058271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39728d-5b11-4ff1-9bf3-bdadf3643ab1 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:40.058577 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39728d-5b11-4ff1-9bf3-bdadf3643ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:40.058835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39728d-5b11-4ff1-9bf3-bdadf3643ab1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:40.059808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39728d-5b11-4ff1-9bf3-bdadf3643ab1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:40.061499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39728d-5b11-4ff1-9bf3-bdadf3643ab1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:40.079703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 506/1012] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 4 18:16:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:40.157317 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fa583-9e9d-4bb1-a1e9-7aa2168c7547 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:40.206208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72bc54-5be9-4e13-a7ec-81ea0cba0a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:40.207053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72bc54-5be9-4e13-a7ec-81ea0cba0a7c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:40.207334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72bc54-5be9-4e13-a7ec-81ea0cba0a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:40.207605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72bc54-5be9-4e13-a7ec-81ea0cba0a7c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:40.208311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72bc54-5be9-4e13-a7ec-81ea0cba0a7c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:40.209762 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72bc54-5be9-4e13-a7ec-81ea0cba0a7c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6c72bc54-5be9-4e13-a7ec-81ea0cba0a7c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:40.223069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:40.224236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:40.225081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 507/1013] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:40.230980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39728d-5b11-4ff1-9bf3-bdadf3643ab1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:40.348460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39728d-5b11-4ff1-9bf3-bdadf3643ab1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:40.383432 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715d673-e637-4e23-875d-6b58482b6083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:40.384179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715d673-e637-4e23-875d-6b58482b6083 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:40.384460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715d673-e637-4e23-875d-6b58482b6083 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:40.384735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715d673-e637-4e23-875d-6b58482b6083 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:40.385445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715d673-e637-4e23-875d-6b58482b6083 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:40.385754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715d673-e637-4e23-875d-6b58482b6083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:40.387130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715d673-e637-4e23-875d-6b58482b6083 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:40.389239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:40.393695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 507/1014] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:40.399727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72bc54-5be9-4e13-a7ec-81ea0cba0a7c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:40.452974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:40.507288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72bc54-5be9-4e13-a7ec-81ea0cba0a7c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:40.541960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919345b9-06ab-44f6-be49-62622aa873ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:40.542984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919345b9-06ab-44f6-be49-62622aa873ff None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:40.543265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919345b9-06ab-44f6-be49-62622aa873ff None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:40.543538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919345b9-06ab-44f6-be49-62622aa873ff None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:40.544524 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919345b9-06ab-44f6-be49-62622aa873ff None admin] RBAC: Adding query filter params (type=compute) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:40.544848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919345b9-06ab-44f6-be49-62622aa873ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:40.546249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919345b9-06ab-44f6-be49-62622aa873ff None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:40.556190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 508/1015] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Jun 4 18:16:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:40.557172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715d673-e637-4e23-875d-6b58482b6083 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:40.661718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715d673-e637-4e23-875d-6b58482b6083 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:40.697481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e11472-b8a1-41c9-bb4e-5e4d58620d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:40.698145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e11472-b8a1-41c9-bb4e-5e4d58620d18 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:40.698389 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e11472-b8a1-41c9-bb4e-5e4d58620d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:40.698694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e11472-b8a1-41c9-bb4e-5e4d58620d18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:40.699434 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e11472-b8a1-41c9-bb4e-5e4d58620d18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:40.701382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e11472-b8a1-41c9-bb4e-5e4d58620d18 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:40.722206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 508/1016] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 4 18:16:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:42.346646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c0020-f6b9-431d-be55-b91341f0fb5b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:42.347218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c0020-f6b9-431d-be55-b91341f0fb5b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:42.347218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c0020-f6b9-431d-be55-b91341f0fb5b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:42.348558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 509/1017] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:42.354117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2ada-0f9b-4849-a812-c0dc7f26efc8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:42.354531 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2ada-0f9b-4849-a812-c0dc7f26efc8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:42.354629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2ada-0f9b-4849-a812-c0dc7f26efc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:42.372377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e8cc2ada-0f9b-4849-a812-c0dc7f26efc8 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:42.373557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e8cc2ada-0f9b-4849-a812-c0dc7f26efc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:42.427050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:42.446943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db84f6-7423-4a3f-9c35-ad1a6580209e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:42.447230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db84f6-7423-4a3f-9c35-ad1a6580209e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:42.447515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db84f6-7423-4a3f-9c35-ad1a6580209e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:42.448950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 510/1018] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:42.460037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44166efd-f348-4e98-908b-70cb3d1581e7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:42.460037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44166efd-f348-4e98-908b-70cb3d1581e7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:42.460037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44166efd-f348-4e98-908b-70cb3d1581e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:42.460359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 509/1019] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:42.473328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-44166efd-f348-4e98-908b-70cb3d1581e7 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:42.474776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-44166efd-f348-4e98-908b-70cb3d1581e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:42.475721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc2ada-0f9b-4849-a812-c0dc7f26efc8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:42.546838 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 511/1020] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:42.570826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44166efd-f348-4e98-908b-70cb3d1581e7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:42.586929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc2ada-0f9b-4849-a812-c0dc7f26efc8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:42.616154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:42.627100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e982a1-57da-494a-ba86-111c4ac33959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:42.628368 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e982a1-57da-494a-ba86-111c4ac33959 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:42.628658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e982a1-57da-494a-ba86-111c4ac33959 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:42.629076 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e982a1-57da-494a-ba86-111c4ac33959 None admin] PATH_INFO: `/v3/services/image` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:42.629736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e982a1-57da-494a-ba86-111c4ac33959 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:42.631117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e982a1-57da-494a-ba86-111c4ac33959 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-16e982a1-57da-494a-ba86-111c4ac33959 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:42.644330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:42.645318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:42.646154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 510/1021] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Jun 4 18:16:42 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:42.651522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e982a1-57da-494a-ba86-111c4ac33959 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:42.679582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44166efd-f348-4e98-908b-70cb3d1581e7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:42.705745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:42.716623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a60eb1-aa7f-4960-bd1a-484b4e108fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:42.717258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60eb1-aa7f-4960-bd1a-484b4e108fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:42.717545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60eb1-aa7f-4960-bd1a-484b4e108fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:42.717828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60eb1-aa7f-4960-bd1a-484b4e108fa5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:42.719162 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a60eb1-aa7f-4960-bd1a-484b4e108fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:42.720705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a60eb1-aa7f-4960-bd1a-484b4e108fa5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:42.722453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 512/1022] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:42.728508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a60eb1-aa7f-4960-bd1a-484b4e108fa5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:42.783502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e982a1-57da-494a-ba86-111c4ac33959 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:42.822119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532f5f9-2663-47c7-88ae-1e9dc139a50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:42.823148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f5f9-2663-47c7-88ae-1e9dc139a50b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:42.823440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f5f9-2663-47c7-88ae-1e9dc139a50b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:42.823718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f5f9-2663-47c7-88ae-1e9dc139a50b None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:42.825165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532f5f9-2663-47c7-88ae-1e9dc139a50b None admin] RBAC: Adding query filter params (name=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:42.825595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532f5f9-2663-47c7-88ae-1e9dc139a50b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:42.827109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532f5f9-2663-47c7-88ae-1e9dc139a50b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:42.832235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 511/1023] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:42.837670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532f5f9-2663-47c7-88ae-1e9dc139a50b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:42.846665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a60eb1-aa7f-4960-bd1a-484b4e108fa5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:42.858069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:42.882314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef54a-94fb-41a5-a6ff-347a3fa2f88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:42.882991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef54a-94fb-41a5-a6ff-347a3fa2f88b None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:42.883277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef54a-94fb-41a5-a6ff-347a3fa2f88b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:42.883555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef54a-94fb-41a5-a6ff-347a3fa2f88b None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:42.884352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ef54a-94fb-41a5-a6ff-347a3fa2f88b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:42.885808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ef54a-94fb-41a5-a6ff-347a3fa2f88b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:42.914458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 513/1024] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:16:42 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:42.961737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532f5f9-2663-47c7-88ae-1e9dc139a50b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:42.973385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:43.002817 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f56c0-a818-4b1e-8e6c-c75e23190482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:43.003511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f56c0-a818-4b1e-8e6c-c75e23190482 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:43.003792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f56c0-a818-4b1e-8e6c-c75e23190482 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:43.004096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f56c0-a818-4b1e-8e6c-c75e23190482 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:43.004816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f56c0-a818-4b1e-8e6c-c75e23190482 None admin] RBAC: Adding query filter params (type=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:43.005122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f56c0-a818-4b1e-8e6c-c75e23190482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:43.006563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f56c0-a818-4b1e-8e6c-c75e23190482 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:43.012610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 512/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:43.018802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef54a-94fb-41a5-a6ff-347a3fa2f88b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:43.065540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631c23-be90-4f19-833b-1dc85fade11f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:43.065895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631c23-be90-4f19-833b-1dc85fade11f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:43.066103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631c23-be90-4f19-833b-1dc85fade11f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:43.067662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 513/1026] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:16:43.073374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf0b0b-d227-4bc0-b887-f50c03372121 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:43.073554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf0b0b-d227-4bc0-b887-f50c03372121 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:43.073862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf0b0b-d227-4bc0-b887-f50c03372121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:43.091693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-afcf0b0b-d227-4bc0-b887-f50c03372121 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:43.092965 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-afcf0b0b-d227-4bc0-b887-f50c03372121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:43.142469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef54a-94fb-41a5-a6ff-347a3fa2f88b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:43.172681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 514/1027] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:43.180649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e3e9a-55d0-4831-bc34-244cb0abfbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:43.181568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e3e9a-55d0-4831-bc34-244cb0abfbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:43.182017 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e3e9a-55d0-4831-bc34-244cb0abfbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:43.182466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e3e9a-55d0-4831-bc34-244cb0abfbc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:43.183428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e3e9a-55d0-4831-bc34-244cb0abfbc8 None admin] RBAC: Adding query filter params (interface=public, service_id=8235eb339fed4335b97d0b2bcc53c953, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:43.183887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e3e9a-55d0-4831-bc34-244cb0abfbc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:43.185779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e3e9a-55d0-4831-bc34-244cb0abfbc8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:43.191514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 514/1028] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 4 18:16:43 2022] GET /identity/v3/endpoints?service_id=8235eb339fed4335b97d0b2bcc53c953&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:43.196453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf0b0b-d227-4bc0-b887-f50c03372121 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:43.196719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e3e9a-55d0-4831-bc34-244cb0abfbc8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:43.225769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:43.307963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e3e9a-55d0-4831-bc34-244cb0abfbc8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:43.313343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf0b0b-d227-4bc0-b887-f50c03372121 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:43.315860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:43.344669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07b80b-a399-4c80-9315-b9f66e3c4690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:43.345269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07b80b-a399-4c80-9315-b9f66e3c4690 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:43.345552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07b80b-a399-4c80-9315-b9f66e3c4690 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:43.345834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07b80b-a399-4c80-9315-b9f66e3c4690 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:43.346527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07b80b-a399-4c80-9315-b9f66e3c4690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:43.347922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07b80b-a399-4c80-9315-b9f66e3c4690 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:43.350105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1d58-02a3-45bf-aa4d-f2f2cc3af855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:43.350922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1d58-02a3-45bf-aa4d-f2f2cc3af855 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:43.351205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1d58-02a3-45bf-aa4d-f2f2cc3af855 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:43.351473 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1d58-02a3-45bf-aa4d-f2f2cc3af855 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:43.361852 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 515/1029] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 4 18:16:43 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:16:43.362973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd1d58-02a3-45bf-aa4d-f2f2cc3af855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-55fd1d58-02a3-45bf-aa4d-f2f2cc3af855 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:43.371561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:43.372698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:43.373536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:43.376390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 515/1030] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 4 18:16:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:43.379454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07b80b-a399-4c80-9315-b9f66e3c4690 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:43.483665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:43.495470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07b80b-a399-4c80-9315-b9f66e3c4690 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:43.531703 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe31d01-a542-44f3-8805-9b828bd6bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:43.532434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31d01-a542-44f3-8805-9b828bd6bc61 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:43.532710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31d01-a542-44f3-8805-9b828bd6bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:43.532986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31d01-a542-44f3-8805-9b828bd6bc61 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:43.533750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe31d01-a542-44f3-8805-9b828bd6bc61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:43.534054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe31d01-a542-44f3-8805-9b828bd6bc61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:43.535460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe31d01-a542-44f3-8805-9b828bd6bc61 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:43.549800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 516/1031] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 4 18:16:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:43.551471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1d58-02a3-45bf-aa4d-f2f2cc3af855 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:43.658003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1d58-02a3-45bf-aa4d-f2f2cc3af855 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:43.693124 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33071ff-6426-463d-afd5-733fcc8f78d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:43.693915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33071ff-6426-463d-afd5-733fcc8f78d0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:43.694189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33071ff-6426-463d-afd5-733fcc8f78d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:43.694460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33071ff-6426-463d-afd5-733fcc8f78d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:43.706209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33071ff-6426-463d-afd5-733fcc8f78d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:43.707746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33071ff-6426-463d-afd5-733fcc8f78d0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f33071ff-6426-463d-afd5-733fcc8f78d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:43.725813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:43.726758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:43.727648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:43.727648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:43.727648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:43.727648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:43.731804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 516/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:43.733361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe31d01-a542-44f3-8805-9b828bd6bc61 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:43.837548 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe31d01-a542-44f3-8805-9b828bd6bc61 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:43.872773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4f0c6-325b-43d2-a654-d6db98983edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:43.873443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4f0c6-325b-43d2-a654-d6db98983edf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:43.873733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4f0c6-325b-43d2-a654-d6db98983edf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:43.873966 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4f0c6-325b-43d2-a654-d6db98983edf None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:43.874701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4f0c6-325b-43d2-a654-d6db98983edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:43.875006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4f0c6-325b-43d2-a654-d6db98983edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:43.876419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4f0c6-325b-43d2-a654-d6db98983edf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:43.889111 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 517/1033] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:43.894748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33071ff-6426-463d-afd5-733fcc8f78d0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:43.914579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:44.001161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33071ff-6426-463d-afd5-733fcc8f78d0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:44.036684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48d9b6-fc34-4937-8997-6da18b7c2032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:44.037497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48d9b6-fc34-4937-8997-6da18b7c2032 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:44.037780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48d9b6-fc34-4937-8997-6da18b7c2032 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:44.038055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48d9b6-fc34-4937-8997-6da18b7c2032 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:44.046139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48d9b6-fc34-4937-8997-6da18b7c2032 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:44.047592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48d9b6-fc34-4937-8997-6da18b7c2032 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-da48d9b6-fc34-4937-8997-6da18b7c2032 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:44.061565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:44.062521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:44.068233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 517/1034] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 4 18:16:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:44.070837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4f0c6-325b-43d2-a654-d6db98983edf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:44.087983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:44.180648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4f0c6-325b-43d2-a654-d6db98983edf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:44.216745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ac0bb-ca07-4739-a405-1ed29c001c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:44.217479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ac0bb-ca07-4739-a405-1ed29c001c60 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:44.217761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ac0bb-ca07-4739-a405-1ed29c001c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:44.218033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ac0bb-ca07-4739-a405-1ed29c001c60 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:44.218879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ac0bb-ca07-4739-a405-1ed29c001c60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:44.219184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ac0bb-ca07-4739-a405-1ed29c001c60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:44.220654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ac0bb-ca07-4739-a405-1ed29c001c60 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:44.238267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 518/1035] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 4 18:16:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:44.243978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48d9b6-fc34-4937-8997-6da18b7c2032 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:44.323224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:44.348121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48d9b6-fc34-4937-8997-6da18b7c2032 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:44.382436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140e945-324f-4899-a6dc-df775f552c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:44.383123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140e945-324f-4899-a6dc-df775f552c9f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:44.383372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140e945-324f-4899-a6dc-df775f552c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:44.383654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140e945-324f-4899-a6dc-df775f552c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:44.452562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140e945-324f-4899-a6dc-df775f552c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:44.453943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140e945-324f-4899-a6dc-df775f552c9f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:44.531722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:44.558649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 518/1036] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:16:44.564405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ac0bb-ca07-4739-a405-1ed29c001c60 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:44.637202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:44.670547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ac0bb-ca07-4739-a405-1ed29c001c60 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:44.705328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01014b-3c0b-40c0-8cb7-c9cc88a4aff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:44.706067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01014b-3c0b-40c0-8cb7-c9cc88a4aff9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:44.706343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01014b-3c0b-40c0-8cb7-c9cc88a4aff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:44.706621 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01014b-3c0b-40c0-8cb7-c9cc88a4aff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:44.717434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01014b-3c0b-40c0-8cb7-c9cc88a4aff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:44.718920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01014b-3c0b-40c0-8cb7-c9cc88a4aff9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1c01014b-3c0b-40c0-8cb7-c9cc88a4aff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:44.736663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:44.737547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:44.738430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:44.738430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:44.738430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:44.738430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:44.740372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 519/1037] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:44.743522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140e945-324f-4899-a6dc-df775f552c9f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:44.852922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140e945-324f-4899-a6dc-df775f552c9f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:44.893405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4449-5bc1-4692-a89e-8a526ce85d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:44.894093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4449-5bc1-4692-a89e-8a526ce85d80 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:44.894356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4449-5bc1-4692-a89e-8a526ce85d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:44.894651 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4449-5bc1-4692-a89e-8a526ce85d80 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:44.895395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f4449-5bc1-4692-a89e-8a526ce85d80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:44.895704 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f4449-5bc1-4692-a89e-8a526ce85d80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:44.897145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f4449-5bc1-4692-a89e-8a526ce85d80 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:44.915158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 519/1038] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:44.916900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01014b-3c0b-40c0-8cb7-c9cc88a4aff9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:45.025965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01014b-3c0b-40c0-8cb7-c9cc88a4aff9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:45.049781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:45.063396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ecd6f-7f72-4e5a-a98f-8a8a6abfc82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:45.064284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ecd6f-7f72-4e5a-a98f-8a8a6abfc82e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:45.064580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ecd6f-7f72-4e5a-a98f-8a8a6abfc82e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:45.064859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ecd6f-7f72-4e5a-a98f-8a8a6abfc82e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:45.072820 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ecd6f-7f72-4e5a-a98f-8a8a6abfc82e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:45.074288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ecd6f-7f72-4e5a-a98f-8a8a6abfc82e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e23ecd6f-7f72-4e5a-a98f-8a8a6abfc82e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:45.089045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:45.089996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:45.090900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:45.090900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:45.090900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:45.090900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:45.090900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:45.090900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:45.090900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:45.090900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:45.091946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 520/1039] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:45.096584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4449-5bc1-4692-a89e-8a526ce85d80 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:45.146244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:45.211981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c48d-7a24-4ed5-909f-f26e8d09dc39 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:45.212282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c48d-7a24-4ed5-909f-f26e8d09dc39 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:45.212554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c48d-7a24-4ed5-909f-f26e8d09dc39 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:45.213930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 521/1040] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:45.218100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4449-5bc1-4692-a89e-8a526ce85d80 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:45.218910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4231-5cb9-468b-b443-7a9b10173852 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:45.219194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4231-5cb9-468b-b443-7a9b10173852 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:45.219469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4231-5cb9-468b-b443-7a9b10173852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:45.236801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-019e4231-5cb9-468b-b443-7a9b10173852 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:45.237977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-019e4231-5cb9-468b-b443-7a9b10173852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:45.256812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f202af-9b99-4115-9d8a-b277681a2339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:45.257771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f202af-9b99-4115-9d8a-b277681a2339 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:45.258059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f202af-9b99-4115-9d8a-b277681a2339 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:45.258338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f202af-9b99-4115-9d8a-b277681a2339 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:45.259137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f202af-9b99-4115-9d8a-b277681a2339 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:45.259448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f202af-9b99-4115-9d8a-b277681a2339 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:45.261471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f202af-9b99-4115-9d8a-b277681a2339 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:45.275248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 520/1041] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:45.281451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f202af-9b99-4115-9d8a-b277681a2339 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:45.322853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 522/1042] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:45.347102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4231-5cb9-468b-b443-7a9b10173852 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:45.387001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:45.394227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f202af-9b99-4115-9d8a-b277681a2339 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:45.428978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634114f-7f16-4ee1-ab12-3c54970d319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:45.429631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634114f-7f16-4ee1-ab12-3c54970d319e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:45.429915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634114f-7f16-4ee1-ab12-3c54970d319e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:45.430191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634114f-7f16-4ee1-ab12-3c54970d319e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:45.431020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634114f-7f16-4ee1-ab12-3c54970d319e None admin] RBAC: Adding query filter params (role.id=1cd3a93991ad4a08a7fbdc65ace3e21e, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=311b3c1e00d64423865b35a188ede79a) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:45.431328 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634114f-7f16-4ee1-ab12-3c54970d319e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:45.432793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634114f-7f16-4ee1-ab12-3c54970d319e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:45.448065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 521/1043] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:45 2022] GET /identity/v3/role_assignments?user.id=311b3c1e00d64423865b35a188ede79a&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=1cd3a93991ad4a08a7fbdc65ace3e21e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:45.463406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4231-5cb9-468b-b443-7a9b10173852 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:45.481446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:45.506288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4eae9-a060-42a8-91c3-146a6aac86c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:45.507121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4eae9-a060-42a8-91c3-146a6aac86c4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:45.507408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4eae9-a060-42a8-91c3-146a6aac86c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:45.507689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4eae9-a060-42a8-91c3-146a6aac86c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:45.508989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4eae9-a060-42a8-91c3-146a6aac86c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:45.510499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4eae9-a060-42a8-91c3-146a6aac86c4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:45.512295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 523/1044] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:45.518403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634114f-7f16-4ee1-ab12-3c54970d319e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:45.609783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6c6ab-8104-4451-a589-ecdc58542a03 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:45.610297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6c6ab-8104-4451-a589-ecdc58542a03 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:45.610297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6c6ab-8104-4451-a589-ecdc58542a03 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:45.611644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 524/1045] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:45.617955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16591-b7aa-4045-a72a-933e0b07ed6e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:45.618282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16591-b7aa-4045-a72a-933e0b07ed6e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:45.618516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16591-b7aa-4045-a72a-933e0b07ed6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:45.633433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634114f-7f16-4ee1-ab12-3c54970d319e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:45.638517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-53c16591-b7aa-4045-a72a-933e0b07ed6e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:45.640081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-53c16591-b7aa-4045-a72a-933e0b07ed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:45.673777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa9233-e810-4454-a6ce-b260d74e9d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:45.674859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa9233-e810-4454-a6ce-b260d74e9d52 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:45.675283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa9233-e810-4454-a6ce-b260d74e9d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:45.675684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa9233-e810-4454-a6ce-b260d74e9d52 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:45.676445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa9233-e810-4454-a6ce-b260d74e9d52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:45.677892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa9233-e810-4454-a6ce-b260d74e9d52 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:45.705510 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 522/1046] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:16:45 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:16:45.715815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 525/1047] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:45.739453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa9233-e810-4454-a6ce-b260d74e9d52 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:45.761003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:45.853925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa9233-e810-4454-a6ce-b260d74e9d52 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:45.890489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab958ec3-88c5-4169-9ff5-96df5461d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:45.891218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab958ec3-88c5-4169-9ff5-96df5461d638 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:45.891507 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab958ec3-88c5-4169-9ff5-96df5461d638 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:45.891784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab958ec3-88c5-4169-9ff5-96df5461d638 None admin] PATH_INFO: `/v3/services/image` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:45.892473 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab958ec3-88c5-4169-9ff5-96df5461d638 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:45.893885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab958ec3-88c5-4169-9ff5-96df5461d638 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ab958ec3-88c5-4169-9ff5-96df5461d638 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:45.906058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:45.907125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:45.907970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 523/1048] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Jun 4 18:16:45 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:45.913758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c16591-b7aa-4045-a72a-933e0b07ed6e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:46.024067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c16591-b7aa-4045-a72a-933e0b07ed6e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:46.035618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:46.061230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf07d08-3977-4b7d-8de8-519083f21609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:46.061893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf07d08-3977-4b7d-8de8-519083f21609 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:46.062190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf07d08-3977-4b7d-8de8-519083f21609 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:46.062475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf07d08-3977-4b7d-8de8-519083f21609 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:46.063192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf07d08-3977-4b7d-8de8-519083f21609 None admin] RBAC: Adding query filter params (name=image) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:46.063502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf07d08-3977-4b7d-8de8-519083f21609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:46.064928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf07d08-3977-4b7d-8de8-519083f21609 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:46.070257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 526/1049] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:46.076364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab958ec3-88c5-4169-9ff5-96df5461d638 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:46.160575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:46.181986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab958ec3-88c5-4169-9ff5-96df5461d638 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:46.217772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be44fd9-a32d-4740-a569-d82394d06666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:46.218468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44fd9-a32d-4740-a569-d82394d06666 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:46.218751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44fd9-a32d-4740-a569-d82394d06666 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:46.219035 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be44fd9-a32d-4740-a569-d82394d06666 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:46.219742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be44fd9-a32d-4740-a569-d82394d06666 None admin] RBAC: Adding query filter params (type=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:46.220079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be44fd9-a32d-4740-a569-d82394d06666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:46.221477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be44fd9-a32d-4740-a569-d82394d06666 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:46.226929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 524/1050] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:46.232772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf07d08-3977-4b7d-8de8-519083f21609 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:46.347162 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf07d08-3977-4b7d-8de8-519083f21609 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:46.382226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b0045-1e38-4a97-a27f-f5139b02845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:46.382887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0045-1e38-4a97-a27f-f5139b02845b None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:46.383167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0045-1e38-4a97-a27f-f5139b02845b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:46.383439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0045-1e38-4a97-a27f-f5139b02845b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:46.384210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b0045-1e38-4a97-a27f-f5139b02845b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:46.385603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b0045-1e38-4a97-a27f-f5139b02845b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:46.412121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 527/1051] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 4 18:16:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:16:47.696955 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537ed19-6cd0-4783-bfc9-637bf631ed1b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:47.697526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537ed19-6cd0-4783-bfc9-637bf631ed1b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:47.697526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537ed19-6cd0-4783-bfc9-637bf631ed1b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:47.699194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 525/1052] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:47.705186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd8eb8-7c8f-456b-ba6f-b0a496a9d1e8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:47.705779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd8eb8-7c8f-456b-ba6f-b0a496a9d1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:47.705779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd8eb8-7c8f-456b-ba6f-b0a496a9d1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:47.725700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d4cd8eb8-7c8f-456b-ba6f-b0a496a9d1e8 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:47.726922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d4cd8eb8-7c8f-456b-ba6f-b0a496a9d1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:47.754822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:47.812098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 528/1053] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:47.831874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537ed19-6cd0-4783-bfc9-637bf631ed1b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:47.946351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537ed19-6cd0-4783-bfc9-637bf631ed1b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:47.981436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8443f-0205-49c1-9621-2de4275af634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:47.982176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8443f-0205-49c1-9621-2de4275af634 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:47.982433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8443f-0205-49c1-9621-2de4275af634 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:47.982725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8443f-0205-49c1-9621-2de4275af634 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:47.993621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8443f-0205-49c1-9621-2de4275af634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-efd8443f-0205-49c1-9621-2de4275af634 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:48.001770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:48.002707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:48.003539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:48.011259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 526/1054] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 4 18:16:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:48.011388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd8eb8-7c8f-456b-ba6f-b0a496a9d1e8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.027187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6778e-1b94-4219-9ed5-2f543ece6ff7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.027459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6778e-1b94-4219-9ed5-2f543ece6ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.027714 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6778e-1b94-4219-9ed5-2f543ece6ff7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.029396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 527/1055] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:16:48.034107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f4a2e-c9ba-4140-9cd4-24a0bffd28d2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.034394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f4a2e-c9ba-4140-9cd4-24a0bffd28d2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.034672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f4a2e-c9ba-4140-9cd4-24a0bffd28d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.041555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:48.054277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c17f4a2e-c9ba-4140-9cd4-24a0bffd28d2 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:48.055481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c17f4a2e-c9ba-4140-9cd4-24a0bffd28d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:48.119324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd8eb8-7c8f-456b-ba6f-b0a496a9d1e8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:48.127749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 528/1056] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:48.151285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f4a2e-c9ba-4140-9cd4-24a0bffd28d2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.155055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed6794-cf8e-47ca-bd07-0367754619c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:48.155561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed6794-cf8e-47ca-bd07-0367754619c4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.155840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed6794-cf8e-47ca-bd07-0367754619c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.156135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed6794-cf8e-47ca-bd07-0367754619c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.156892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed6794-cf8e-47ca-bd07-0367754619c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:48.157192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed6794-cf8e-47ca-bd07-0367754619c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:48.158570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed6794-cf8e-47ca-bd07-0367754619c4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:48.168774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 529/1057] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:48.174321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed6794-cf8e-47ca-bd07-0367754619c4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.193427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:48.256463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f4a2e-c9ba-4140-9cd4-24a0bffd28d2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:48.280844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed6794-cf8e-47ca-bd07-0367754619c4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:48.297586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e085ad-e232-4750-8177-8c5ac2c4073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:48.298404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e085ad-e232-4750-8177-8c5ac2c4073a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.298688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e085ad-e232-4750-8177-8c5ac2c4073a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.298966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e085ad-e232-4750-8177-8c5ac2c4073a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.305220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:48.311501 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e085ad-e232-4750-8177-8c5ac2c4073a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-75e085ad-e232-4750-8177-8c5ac2c4073a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:48.319909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:48.320855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:48.321681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 529/1058] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:48.325715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd289a17-1e76-4e01-808a-c95696b68721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:48.326650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd289a17-1e76-4e01-808a-c95696b68721 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.326939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd289a17-1e76-4e01-808a-c95696b68721 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.327216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd289a17-1e76-4e01-808a-c95696b68721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.327568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e085ad-e232-4750-8177-8c5ac2c4073a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.339885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd289a17-1e76-4e01-808a-c95696b68721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:48.341546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd289a17-1e76-4e01-808a-c95696b68721 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-bd289a17-1e76-4e01-808a-c95696b68721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:48.361257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:48.362260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:48.363152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:48.363152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:48.363152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:48.363152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:48.363152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 530/1059] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:48.368190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd289a17-1e76-4e01-808a-c95696b68721 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.438561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e085ad-e232-4750-8177-8c5ac2c4073a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:48.442918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:48.474969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd289a17-1e76-4e01-808a-c95696b68721 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:48.475305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755f189-bc47-4faa-bf84-9ddf162ec66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:48.475984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f189-bc47-4faa-bf84-9ddf162ec66c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.476308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f189-bc47-4faa-bf84-9ddf162ec66c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.476592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755f189-bc47-4faa-bf84-9ddf162ec66c None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.477939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755f189-bc47-4faa-bf84-9ddf162ec66c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:48.477939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755f189-bc47-4faa-bf84-9ddf162ec66c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:48.479003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755f189-bc47-4faa-bf84-9ddf162ec66c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:48.488066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 530/1060] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:48.493639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755f189-bc47-4faa-bf84-9ddf162ec66c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.513421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54460602-6285-457a-a603-09908d0b614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:48.514023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54460602-6285-457a-a603-09908d0b614d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.514306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54460602-6285-457a-a603-09908d0b614d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.514584 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54460602-6285-457a-a603-09908d0b614d None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.515341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54460602-6285-457a-a603-09908d0b614d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:48.515658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54460602-6285-457a-a603-09908d0b614d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:48.517090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54460602-6285-457a-a603-09908d0b614d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:48.529275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 531/1061] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:48.534897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54460602-6285-457a-a603-09908d0b614d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.561226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:48.608585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755f189-bc47-4faa-bf84-9ddf162ec66c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:48.640737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54460602-6285-457a-a603-09908d0b614d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:48.644562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d12b7-5c80-421a-9b7a-6bee2c8d8a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:48.645524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d12b7-5c80-421a-9b7a-6bee2c8d8a26 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.645869 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d12b7-5c80-421a-9b7a-6bee2c8d8a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.646232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d12b7-5c80-421a-9b7a-6bee2c8d8a26 None admin] PATH_INFO: `/v3/users/e0a0f3fe4238442594d2add24735dee2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.660457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d12b7-5c80-421a-9b7a-6bee2c8d8a26 None admin] RBAC: Authorizing `identity:get_user(user_id=e0a0f3fe4238442594d2add24735dee2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:48.661936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d12b7-5c80-421a-9b7a-6bee2c8d8a26 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:48.663658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 531/1062] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/users/e0a0f3fe4238442594d2add24735dee2 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:48.664920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5789ee-2ca9-4600-9621-1267d876d6ff None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.665197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5789ee-2ca9-4600-9621-1267d876d6ff None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.665466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5789ee-2ca9-4600-9621-1267d876d6ff None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.666668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 532/1063] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:48.669547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5789ee-2ca9-4600-9621-1267d876d6ff None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.677841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:48.684341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b7719-a157-48a2-bf92-daf7e9cc04be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:48.685154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7719-a157-48a2-bf92-daf7e9cc04be None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.685440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7719-a157-48a2-bf92-daf7e9cc04be None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.685716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7719-a157-48a2-bf92-daf7e9cc04be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.693067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b7719-a157-48a2-bf92-daf7e9cc04be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:48.694537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b7719-a157-48a2-bf92-daf7e9cc04be None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8f6b7719-a157-48a2-bf92-daf7e9cc04be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:48.709665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:48.711168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:48.712125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 532/1064] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:48.712704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ee270-6f62-4dcb-8a15-417170874591 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.712771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ee270-6f62-4dcb-8a15-417170874591 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.713006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ee270-6f62-4dcb-8a15-417170874591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.728608 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a71ee270-6f62-4dcb-8a15-417170874591 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:48.729793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a71ee270-6f62-4dcb-8a15-417170874591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:48.774115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5789ee-2ca9-4600-9621-1267d876d6ff None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:48.788144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:48.796302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 533/1065] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:48.797148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ee270-6f62-4dcb-8a15-417170874591 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.809681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4282f74-84e3-4661-9ff9-79bbb5927e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:48.810334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4282f74-84e3-4661-9ff9-79bbb5927e5c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.810615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4282f74-84e3-4661-9ff9-79bbb5927e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.810910 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4282f74-84e3-4661-9ff9-79bbb5927e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.878259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4282f74-84e3-4661-9ff9-79bbb5927e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:48.879749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4282f74-84e3-4661-9ff9-79bbb5927e5c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:48.896782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ee270-6f62-4dcb-8a15-417170874591 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:48.922139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:48.937860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a30be-8d87-4a1c-99f8-8841d59dff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:48.938552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a30be-8d87-4a1c-99f8-8841d59dff0f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:48.938838 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a30be-8d87-4a1c-99f8-8841d59dff0f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:48.939118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a30be-8d87-4a1c-99f8-8841d59dff0f None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:48.940020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a30be-8d87-4a1c-99f8-8841d59dff0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:48.940342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a30be-8d87-4a1c-99f8-8841d59dff0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:48.941798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a30be-8d87-4a1c-99f8-8841d59dff0f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:48.959390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 534/1066] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:48.960290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a30be-8d87-4a1c-99f8-8841d59dff0f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.976677 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 533/1067] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:16:48.977644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4282f74-84e3-4661-9ff9-79bbb5927e5c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:48.994255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:49.060064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a30be-8d87-4a1c-99f8-8841d59dff0f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:49.077803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4282f74-84e3-4661-9ff9-79bbb5927e5c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:49.093458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80e1c8-c286-43a8-930a-cd1b2f1017e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:49.094144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80e1c8-c286-43a8-930a-cd1b2f1017e9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:49.094431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80e1c8-c286-43a8-930a-cd1b2f1017e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:49.094709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80e1c8-c286-43a8-930a-cd1b2f1017e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:49.111181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657445b8-9bcd-4503-ac92-f486eb79ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:49.111974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657445b8-9bcd-4503-ac92-f486eb79ef64 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:49.112281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657445b8-9bcd-4503-ac92-f486eb79ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:49.112550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657445b8-9bcd-4503-ac92-f486eb79ef64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:49.122346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657445b8-9bcd-4503-ac92-f486eb79ef64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:49.123798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657445b8-9bcd-4503-ac92-f486eb79ef64 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:49.139442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-657445b8-9bcd-4503-ac92-f486eb79ef64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:49.140884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:49.141983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:49.143135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:49.143135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:49.143135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:49.143135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:49.143135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 534/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:49.143135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657445b8-9bcd-4503-ac92-f486eb79ef64 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:49.165980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80e1c8-c286-43a8-930a-cd1b2f1017e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:49.167794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80e1c8-c286-43a8-930a-cd1b2f1017e9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:49.204430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:49.238854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657445b8-9bcd-4503-ac92-f486eb79ef64 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:49.264729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 535/1069] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:16:49.265766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80e1c8-c286-43a8-930a-cd1b2f1017e9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:49.276878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ca5b-0201-446e-9ccd-08378a0c9298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:49.277751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ca5b-0201-446e-9ccd-08378a0c9298 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:49.278174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ca5b-0201-446e-9ccd-08378a0c9298 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:49.278454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ca5b-0201-446e-9ccd-08378a0c9298 None admin] PATH_INFO: `/v3/projects/5b59c5f6dea846b493d978c81d9939eb` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:49.279639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ca5b-0201-446e-9ccd-08378a0c9298 None admin] RBAC: Authorizing `identity:get_project(project_id=5b59c5f6dea846b493d978c81d9939eb)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:49.281134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ca5b-0201-446e-9ccd-08378a0c9298 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:49.287709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 535/1070] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:16:49 2022] GET /identity/v3/projects/5b59c5f6dea846b493d978c81d9939eb => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:49.287709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ca5b-0201-446e-9ccd-08378a0c9298 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:49.343408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:49.366246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80e1c8-c286-43a8-930a-cd1b2f1017e9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:49.384736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ca5b-0201-446e-9ccd-08378a0c9298 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:49.401230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff3b35-3299-42e7-ac7f-5dfd817e3336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:49.401902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff3b35-3299-42e7-ac7f-5dfd817e3336 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:49.402176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff3b35-3299-42e7-ac7f-5dfd817e3336 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:49.402448 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff3b35-3299-42e7-ac7f-5dfd817e3336 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:49.403269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff3b35-3299-42e7-ac7f-5dfd817e3336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:49.403573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff3b35-3299-42e7-ac7f-5dfd817e3336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:49.404977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff3b35-3299-42e7-ac7f-5dfd817e3336 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:49.415880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 536/1071] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:49.416693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff3b35-3299-42e7-ac7f-5dfd817e3336 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:49.418766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a3c38-9039-471c-8a92-b5dd54563aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:49.419860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3c38-9039-471c-8a92-b5dd54563aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:49.420348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3c38-9039-471c-8a92-b5dd54563aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:49.420629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a3c38-9039-471c-8a92-b5dd54563aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:49.423076 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:49.433042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a3c38-9039-471c-8a92-b5dd54563aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:49.434584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a3c38-9039-471c-8a92-b5dd54563aa1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-547a3c38-9039-471c-8a92-b5dd54563aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:49.451930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:49.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:49.454042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:49.454042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:49.454042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:49.454042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:49.454042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 536/1072] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:49.454042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a3c38-9039-471c-8a92-b5dd54563aa1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:49.518450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff3b35-3299-42e7-ac7f-5dfd817e3336 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:49.552370 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cf58e-2f05-4e6d-86ba-c26cba5abcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:49.553032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cf58e-2f05-4e6d-86ba-c26cba5abcba None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:49.553314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cf58e-2f05-4e6d-86ba-c26cba5abcba None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:49.553589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cf58e-2f05-4e6d-86ba-c26cba5abcba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:49.553709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a3c38-9039-471c-8a92-b5dd54563aa1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:49.554417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cf58e-2f05-4e6d-86ba-c26cba5abcba None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=5b59c5f6dea846b493d978c81d9939eb, user.id=e0a0f3fe4238442594d2add24735dee2) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:49.554729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cf58e-2f05-4e6d-86ba-c26cba5abcba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:49.556209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cf58e-2f05-4e6d-86ba-c26cba5abcba None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:49.576809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 537/1073] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:49 2022] GET /identity/v3/role_assignments?user.id=e0a0f3fe4238442594d2add24735dee2&scope.project.id=5b59c5f6dea846b493d978c81d9939eb&role.id=9f557e97d94b4b499a6765419452e1ef => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:49.576809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cf58e-2f05-4e6d-86ba-c26cba5abcba None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:49.576809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:49.594534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefe6bc-5072-4c75-b776-2c65721f5b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:49.595258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefe6bc-5072-4c75-b776-2c65721f5b27 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:49.595538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefe6bc-5072-4c75-b776-2c65721f5b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:49.595806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefe6bc-5072-4c75-b776-2c65721f5b27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:49.604255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefe6bc-5072-4c75-b776-2c65721f5b27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:49.605738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefe6bc-5072-4c75-b776-2c65721f5b27 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-beefe6bc-5072-4c75-b776-2c65721f5b27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:49.621752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:49.622750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:49.623633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:49.623633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:49.623633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:49.623633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:49.623633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:49.623633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:49.623633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:49.623633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:49.623633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 537/1074] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:49.629071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefe6bc-5072-4c75-b776-2c65721f5b27 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:49.683521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:49.685951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cf58e-2f05-4e6d-86ba-c26cba5abcba None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:49.725501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b9c53-e138-4fac-a434-59059a10cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:49.726491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b9c53-e138-4fac-a434-59059a10cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:49.726778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b9c53-e138-4fac-a434-59059a10cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:49.727055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b9c53-e138-4fac-a434-59059a10cfe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:49.727806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b9c53-e138-4fac-a434-59059a10cfe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:49.728155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b9c53-e138-4fac-a434-59059a10cfe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:49.730069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b9c53-e138-4fac-a434-59059a10cfe6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:49.741685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefe6bc-5072-4c75-b776-2c65721f5b27 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:49.756058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 538/1075] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:49.782442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3738cf-a3a1-424c-bdf7-359de1c08e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:49.783189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3738cf-a3a1-424c-bdf7-359de1c08e39 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:49.783477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3738cf-a3a1-424c-bdf7-359de1c08e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:49.783757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3738cf-a3a1-424c-bdf7-359de1c08e39 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:49.784611 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3738cf-a3a1-424c-bdf7-359de1c08e39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:49.784927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3738cf-a3a1-424c-bdf7-359de1c08e39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:49.786476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3738cf-a3a1-424c-bdf7-359de1c08e39 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:49.806379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 538/1076] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:49.807770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b9c53-e138-4fac-a434-59059a10cfe6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:49.877765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:49.923621 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b9c53-e138-4fac-a434-59059a10cfe6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:49.963696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960103c-009b-49b7-aa5b-3fedc7659c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:49.964692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960103c-009b-49b7-aa5b-3fedc7659c83 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:49.964965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960103c-009b-49b7-aa5b-3fedc7659c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:49.965240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960103c-009b-49b7-aa5b-3fedc7659c83 None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/311b3c1e00d64423865b35a188ede79a/roles/1cd3a93991ad4a08a7fbdc65ace3e21e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:49.967672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960103c-009b-49b7-aa5b-3fedc7659c83 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=311b3c1e00d64423865b35a188ede79a, role_id=1cd3a93991ad4a08a7fbdc65ace3e21e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:49.969231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960103c-009b-49b7-aa5b-3fedc7659c83 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:49.985657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 539/1077] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:16:49 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/311b3c1e00d64423865b35a188ede79a/roles/1cd3a93991ad4a08a7fbdc65ace3e21e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:16:51.821037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987922b1-33ca-482a-83c2-068e1db6ccad None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:51.821658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987922b1-33ca-482a-83c2-068e1db6ccad None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:51.821658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987922b1-33ca-482a-83c2-068e1db6ccad None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:51.823030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 539/1078] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:51.828991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3de731-36a1-45e5-8ca5-f0fca0dee899 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:51.829435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3de731-36a1-45e5-8ca5-f0fca0dee899 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:51.829584 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3de731-36a1-45e5-8ca5-f0fca0dee899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:51.847310 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0f3de731-36a1-45e5-8ca5-f0fca0dee899 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:51.848531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0f3de731-36a1-45e5-8ca5-f0fca0dee899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:51.925276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 540/1079] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:16:51.947966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987922b1-33ca-482a-83c2-068e1db6ccad None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:52.055832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987922b1-33ca-482a-83c2-068e1db6ccad None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:52.064535 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:52.093673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa85638-4db1-49fa-9a90-0d5827546501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:52.094383 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85638-4db1-49fa-9a90-0d5827546501 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.094666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85638-4db1-49fa-9a90-0d5827546501 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.094940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85638-4db1-49fa-9a90-0d5827546501 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.105417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa85638-4db1-49fa-9a90-0d5827546501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3fa85638-4db1-49fa-9a90-0d5827546501 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:52.113430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:52.114463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:52.115572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 540/1080] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:52.120796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3de731-36a1-45e5-8ca5-f0fca0dee899 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:52.175823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:52.195801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41296e3c-ef76-495e-b7f4-95f2944764c8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.196199 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41296e3c-ef76-495e-b7f4-95f2944764c8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.196479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41296e3c-ef76-495e-b7f4-95f2944764c8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.197846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 541/1081] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:52.203287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5f57-2d76-4142-b056-d4aa81854a65 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.203574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5f57-2d76-4142-b056-d4aa81854a65 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.203846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5f57-2d76-4142-b056-d4aa81854a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.222125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-603a5f57-2d76-4142-b056-d4aa81854a65 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:52.223416 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-603a5f57-2d76-4142-b056-d4aa81854a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:52.224766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3de731-36a1-45e5-8ca5-f0fca0dee899 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:52.260488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ccef2-00f2-472e-82ae-d6f8f93640e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:52.261169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ccef2-00f2-472e-82ae-d6f8f93640e8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.261455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ccef2-00f2-472e-82ae-d6f8f93640e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.261733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ccef2-00f2-472e-82ae-d6f8f93640e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.262509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ccef2-00f2-472e-82ae-d6f8f93640e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:52.262831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ccef2-00f2-472e-82ae-d6f8f93640e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:52.264257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ccef2-00f2-472e-82ae-d6f8f93640e8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:52.272549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 541/1082] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:52.278539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ccef2-00f2-472e-82ae-d6f8f93640e8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:52.291995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 542/1083] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:52.316149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a5f57-2d76-4142-b056-d4aa81854a65 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:52.381077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ccef2-00f2-472e-82ae-d6f8f93640e8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:52.394088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:52.409073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:52.415755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54bd25-0ff6-410a-92ce-ee1b63116c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:52.415916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a5f57-2d76-4142-b056-d4aa81854a65 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:52.416668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54bd25-0ff6-410a-92ce-ee1b63116c1b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.416947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54bd25-0ff6-410a-92ce-ee1b63116c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.417650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54bd25-0ff6-410a-92ce-ee1b63116c1b None admin] PATH_INFO: `/v3/users/e0a0f3fe4238442594d2add24735dee2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.418804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54bd25-0ff6-410a-92ce-ee1b63116c1b None admin] RBAC: Authorizing `identity:get_user(user_id=e0a0f3fe4238442594d2add24735dee2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:52.420254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54bd25-0ff6-410a-92ce-ee1b63116c1b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:52.422188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 542/1084] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:16:52 2022] GET /identity/v3/users/e0a0f3fe4238442594d2add24735dee2 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:52.427857 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54bd25-0ff6-410a-92ce-ee1b63116c1b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:52.451962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee2e81-da30-4d8a-a9b9-409c78b9eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:52.452812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee2e81-da30-4d8a-a9b9-409c78b9eec1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.453098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee2e81-da30-4d8a-a9b9-409c78b9eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.453371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee2e81-da30-4d8a-a9b9-409c78b9eec1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.464341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee2e81-da30-4d8a-a9b9-409c78b9eec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c5ee2e81-da30-4d8a-a9b9-409c78b9eec1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:52.472560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:52.473762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:52.474780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 543/1085] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Jun 4 18:16:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:52.479729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee2e81-da30-4d8a-a9b9-409c78b9eec1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:52.531923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54bd25-0ff6-410a-92ce-ee1b63116c1b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:52.565830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f2433-873a-4ae8-bbe1-10ed83545d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:52.566722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f2433-873a-4ae8-bbe1-10ed83545d90 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.567007 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f2433-873a-4ae8-bbe1-10ed83545d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.567280 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f2433-873a-4ae8-bbe1-10ed83545d90 None admin] PATH_INFO: `/v3/projects/5b59c5f6dea846b493d978c81d9939eb` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.568539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f2433-873a-4ae8-bbe1-10ed83545d90 None admin] RBAC: Authorizing `identity:get_project(project_id=5b59c5f6dea846b493d978c81d9939eb)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:52.570005 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f2433-873a-4ae8-bbe1-10ed83545d90 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:52.571708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 543/1086] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:16:52 2022] GET /identity/v3/projects/5b59c5f6dea846b493d978c81d9939eb => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:52.577795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f2433-873a-4ae8-bbe1-10ed83545d90 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:52.582113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee2e81-da30-4d8a-a9b9-409c78b9eec1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:52.616944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ac08d-fa68-40a8-a5c6-3ffcd588d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:52.617613 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac08d-fa68-40a8-a5c6-3ffcd588d72f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.617898 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac08d-fa68-40a8-a5c6-3ffcd588d72f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.618175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac08d-fa68-40a8-a5c6-3ffcd588d72f None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.618923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ac08d-fa68-40a8-a5c6-3ffcd588d72f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:52.619230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ac08d-fa68-40a8-a5c6-3ffcd588d72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:52.620654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ac08d-fa68-40a8-a5c6-3ffcd588d72f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:52.628178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:52.629022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 544/1087] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 4 18:16:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:16:52.635153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ac08d-fa68-40a8-a5c6-3ffcd588d72f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:52.654101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:52.679864 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f2433-873a-4ae8-bbe1-10ed83545d90 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:52.714282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbddf99-5497-4b0f-ae20-68f9889389a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:52.715178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbddf99-5497-4b0f-ae20-68f9889389a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.715713 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbddf99-5497-4b0f-ae20-68f9889389a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.715979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbddf99-5497-4b0f-ae20-68f9889389a2 None admin] PATH_INFO: `/v3/projects/5b59c5f6dea846b493d978c81d9939eb/users/e0a0f3fe4238442594d2add24735dee2/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.717950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbddf99-5497-4b0f-ae20-68f9889389a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b59c5f6dea846b493d978c81d9939eb, user_id=e0a0f3fe4238442594d2add24735dee2, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:52.719398 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbddf99-5497-4b0f-ae20-68f9889389a2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:52.735265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 544/1088] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:16:52 2022] PUT /identity/v3/projects/5b59c5f6dea846b493d978c81d9939eb/users/e0a0f3fe4238442594d2add24735dee2/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:16:52.735617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ac08d-fa68-40a8-a5c6-3ffcd588d72f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:52.771813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce104f-bfd0-4810-b4a2-ef4fa9b52ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:52.772678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce104f-bfd0-4810-b4a2-ef4fa9b52ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.772961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce104f-bfd0-4810-b4a2-ef4fa9b52ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.773235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce104f-bfd0-4810-b4a2-ef4fa9b52ec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.785761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce104f-bfd0-4810-b4a2-ef4fa9b52ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:52.787247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce104f-bfd0-4810-b4a2-ef4fa9b52ec6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-83ce104f-bfd0-4810-b4a2-ef4fa9b52ec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:52.806335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:52.807407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:52.808496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:52.808496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:52.808496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:52.808496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:52.808496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 545/1089] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:16:52.813842 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbddf99-5497-4b0f-ae20-68f9889389a2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:52.926017 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbddf99-5497-4b0f-ae20-68f9889389a2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:52.939262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:52.964950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1de2d-4d23-4f9a-9214-482c5a7d777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:52.965782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1de2d-4d23-4f9a-9214-482c5a7d777b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:52.966068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1de2d-4d23-4f9a-9214-482c5a7d777b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:52.966349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1de2d-4d23-4f9a-9214-482c5a7d777b None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:52.967090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1de2d-4d23-4f9a-9214-482c5a7d777b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:52.967405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1de2d-4d23-4f9a-9214-482c5a7d777b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:52.968834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1de2d-4d23-4f9a-9214-482c5a7d777b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:52.980885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 545/1090] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:52.986736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce104f-bfd0-4810-b4a2-ef4fa9b52ec6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:53.057283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:53.089476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce104f-bfd0-4810-b4a2-ef4fa9b52ec6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:53.124626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e486b2b-146f-4e48-813c-2f02ad67d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:53.125415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486b2b-146f-4e48-813c-2f02ad67d694 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:53.125690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486b2b-146f-4e48-813c-2f02ad67d694 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:53.125959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486b2b-146f-4e48-813c-2f02ad67d694 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:53.133816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e486b2b-146f-4e48-813c-2f02ad67d694 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:53.135249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e486b2b-146f-4e48-813c-2f02ad67d694 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4e486b2b-146f-4e48-813c-2f02ad67d694 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:16:53.149365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:53.150372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:53.151308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 546/1091] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Jun 4 18:16:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:53.156735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1de2d-4d23-4f9a-9214-482c5a7d777b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:53.262049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1de2d-4d23-4f9a-9214-482c5a7d777b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:53.297677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f2e01-011d-400c-821f-2e07dd845764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:53.298363 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f2e01-011d-400c-821f-2e07dd845764 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:53.298648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f2e01-011d-400c-821f-2e07dd845764 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:53.298923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f2e01-011d-400c-821f-2e07dd845764 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:53.299779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f2e01-011d-400c-821f-2e07dd845764 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:53.300199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f2e01-011d-400c-821f-2e07dd845764 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:53.301660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f2e01-011d-400c-821f-2e07dd845764 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:53.324316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 546/1092] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Jun 4 18:16:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:53.325874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e486b2b-146f-4e48-813c-2f02ad67d694 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:53.428698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e486b2b-146f-4e48-813c-2f02ad67d694 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:53.457315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:53.463734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0b9d8-d7ce-4976-a140-b226203285d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:53.464430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b9d8-d7ce-4976-a140-b226203285d5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:53.464712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b9d8-d7ce-4976-a140-b226203285d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:53.464991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b9d8-d7ce-4976-a140-b226203285d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:53.533069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0b9d8-d7ce-4976-a140-b226203285d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:53.534481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0b9d8-d7ce-4976-a140-b226203285d5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:53.634039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 547/1093] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:16:53.640033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f2e01-011d-400c-821f-2e07dd845764 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:53.668979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:53.741084 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f2e01-011d-400c-821f-2e07dd845764 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:53.776848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95449-8e0d-453a-9b86-5ed076cb8162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:53.777650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95449-8e0d-453a-9b86-5ed076cb8162 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:53.778152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95449-8e0d-453a-9b86-5ed076cb8162 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:53.778537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95449-8e0d-453a-9b86-5ed076cb8162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:53.789119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b95449-8e0d-453a-9b86-5ed076cb8162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:53.790527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b95449-8e0d-453a-9b86-5ed076cb8162 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b0b95449-8e0d-453a-9b86-5ed076cb8162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:16:53.808332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:53.809357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:53.810424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:16:53.810424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:16:53.810424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:16:53.810424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:53.810424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 547/1094] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:53.815390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0b9d8-d7ce-4976-a140-b226203285d5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:53.847589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:53.920515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0b9d8-d7ce-4976-a140-b226203285d5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:53.954987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3789196-746b-4990-a892-5b85107688bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:53.955643 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3789196-746b-4990-a892-5b85107688bd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:53.955922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3789196-746b-4990-a892-5b85107688bd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:53.956221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3789196-746b-4990-a892-5b85107688bd None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:53.956930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3789196-746b-4990-a892-5b85107688bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:53.957225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3789196-746b-4990-a892-5b85107688bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:53.958595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3789196-746b-4990-a892-5b85107688bd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:53.970860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 548/1095] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:53.976878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95449-8e0d-453a-9b86-5ed076cb8162 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:54.060124 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:54.081522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95449-8e0d-453a-9b86-5ed076cb8162 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:54.121702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9000fbd-cd3d-42a0-a915-bfe982e493b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:54.122965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9000fbd-cd3d-42a0-a915-bfe982e493b6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:54.123412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9000fbd-cd3d-42a0-a915-bfe982e493b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:54.123849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9000fbd-cd3d-42a0-a915-bfe982e493b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:54.131273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9000fbd-cd3d-42a0-a915-bfe982e493b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:54.132949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9000fbd-cd3d-42a0-a915-bfe982e493b6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b9000fbd-cd3d-42a0-a915-bfe982e493b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:16:54.146954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:54.148115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:54.149237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:16:54.149237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:16:54.149237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:16:54.149237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:16:54.149237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:16:54.149237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:16:54.149237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:16:54.149237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:16:54.151367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 548/1096] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:54.157467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3789196-746b-4990-a892-5b85107688bd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:54.247595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:54.257673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3789196-746b-4990-a892-5b85107688bd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:54.294308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b021d-2045-45ef-a74f-390ba06dac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:54.294972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b021d-2045-45ef-a74f-390ba06dac4f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:54.295258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b021d-2045-45ef-a74f-390ba06dac4f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:54.295533 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b021d-2045-45ef-a74f-390ba06dac4f None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:54.296356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b021d-2045-45ef-a74f-390ba06dac4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:54.296665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b021d-2045-45ef-a74f-390ba06dac4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:54.298107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b021d-2045-45ef-a74f-390ba06dac4f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:54.314017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 549/1097] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:54.319936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9000fbd-cd3d-42a0-a915-bfe982e493b6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:54.421720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9000fbd-cd3d-42a0-a915-bfe982e493b6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:54.456281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8cc18-f0c5-4fb8-942c-95a174cc3708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:54.456918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8cc18-f0c5-4fb8-942c-95a174cc3708 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:54.457197 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8cc18-f0c5-4fb8-942c-95a174cc3708 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:54.457465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8cc18-f0c5-4fb8-942c-95a174cc3708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:54.458293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8cc18-f0c5-4fb8-942c-95a174cc3708 None admin] RBAC: Adding query filter params (role.id=1cd3a93991ad4a08a7fbdc65ace3e21e, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=311b3c1e00d64423865b35a188ede79a) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:54.458602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8cc18-f0c5-4fb8-942c-95a174cc3708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:54.460079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8cc18-f0c5-4fb8-942c-95a174cc3708 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:54.466266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 549/1098] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:54 2022] GET /identity/v3/role_assignments?user.id=311b3c1e00d64423865b35a188ede79a&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=1cd3a93991ad4a08a7fbdc65ace3e21e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:54.961728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e9cb-f9ad-4cff-ab19-449edcc34f32 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:54.961996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e9cb-f9ad-4cff-ab19-449edcc34f32 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:54.962255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e9cb-f9ad-4cff-ab19-449edcc34f32 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:54.963647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 550/1099] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:54.969606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15919d15-3b6e-41d8-8404-180559accc79 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:54.969891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15919d15-3b6e-41d8-8404-180559accc79 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:54.970165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15919d15-3b6e-41d8-8404-180559accc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:54.977740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:54.990724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-15919d15-3b6e-41d8-8404-180559accc79 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:54.991947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-15919d15-3b6e-41d8-8404-180559accc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:55.061754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 550/1100] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:55.085255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405e9cb-f9ad-4cff-ab19-449edcc34f32 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:55.196702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405e9cb-f9ad-4cff-ab19-449edcc34f32 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:55.232602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616bc2a-233f-444f-b154-5ba079e2b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:55.233336 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616bc2a-233f-444f-b154-5ba079e2b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:55.233619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616bc2a-233f-444f-b154-5ba079e2b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:55.233894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616bc2a-233f-444f-b154-5ba079e2b7f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:55.244273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616bc2a-233f-444f-b154-5ba079e2b7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f616bc2a-233f-444f-b154-5ba079e2b7f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:16:55.252067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:16:55.253068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:16:55.253900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 551/1101] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:16:55.259417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15919d15-3b6e-41d8-8404-180559accc79 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:55.363518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15919d15-3b6e-41d8-8404-180559accc79 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:55.396395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850f536-a15e-40d3-beed-6e21481054ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:55.397062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850f536-a15e-40d3-beed-6e21481054ce None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:55.397344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850f536-a15e-40d3-beed-6e21481054ce None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:55.397619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850f536-a15e-40d3-beed-6e21481054ce None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:55.398366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850f536-a15e-40d3-beed-6e21481054ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:55.398669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850f536-a15e-40d3-beed-6e21481054ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:55.400075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850f536-a15e-40d3-beed-6e21481054ce None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:55.401384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:55.409784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 551/1102] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:55.419301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616bc2a-233f-444f-b154-5ba079e2b7f8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:55.434403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:55.524659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616bc2a-233f-444f-b154-5ba079e2b7f8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:55.559150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7961c-bd58-496b-b110-6c9a83ec3e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:55.560109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7961c-bd58-496b-b110-6c9a83ec3e57 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:55.560385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7961c-bd58-496b-b110-6c9a83ec3e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:55.560649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7961c-bd58-496b-b110-6c9a83ec3e57 None admin] PATH_INFO: `/v3/users/e0a0f3fe4238442594d2add24735dee2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:55.561825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7961c-bd58-496b-b110-6c9a83ec3e57 None admin] RBAC: Authorizing `identity:get_user(user_id=e0a0f3fe4238442594d2add24735dee2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:55.563261 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7961c-bd58-496b-b110-6c9a83ec3e57 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:55.564907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 552/1103] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:16:55 2022] GET /identity/v3/users/e0a0f3fe4238442594d2add24735dee2 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:55.573564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850f536-a15e-40d3-beed-6e21481054ce None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:55.677055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850f536-a15e-40d3-beed-6e21481054ce None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:55.711050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612c9b8-f77c-48c8-87f7-4700162f9d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:55.711700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612c9b8-f77c-48c8-87f7-4700162f9d2a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:55.711982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612c9b8-f77c-48c8-87f7-4700162f9d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:55.712290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612c9b8-f77c-48c8-87f7-4700162f9d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:55.779745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:55.786835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612c9b8-f77c-48c8-87f7-4700162f9d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:55.788372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612c9b8-f77c-48c8-87f7-4700162f9d2a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:55.889790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 552/1104] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:16:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 18:16:55.896732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7961c-bd58-496b-b110-6c9a83ec3e57 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:55.979820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:56.002736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7961c-bd58-496b-b110-6c9a83ec3e57 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:56.040238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a4b9c-25cc-4838-be19-755bf7afc59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:56.041042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a4b9c-25cc-4838-be19-755bf7afc59a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:56.041324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a4b9c-25cc-4838-be19-755bf7afc59a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:56.041599 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a4b9c-25cc-4838-be19-755bf7afc59a None admin] PATH_INFO: `/v3/projects/5b59c5f6dea846b493d978c81d9939eb` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:56.043191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a4b9c-25cc-4838-be19-755bf7afc59a None admin] RBAC: Authorizing `identity:get_project(project_id=5b59c5f6dea846b493d978c81d9939eb)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:56.045187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a4b9c-25cc-4838-be19-755bf7afc59a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:56.046884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 553/1105] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:16:55 2022] GET /identity/v3/projects/5b59c5f6dea846b493d978c81d9939eb => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:56.053089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612c9b8-f77c-48c8-87f7-4700162f9d2a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:56.154551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:56.160967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612c9b8-f77c-48c8-87f7-4700162f9d2a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:56.195715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148af14-bf05-43e9-b651-46401ac0b1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:56.196465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148af14-bf05-43e9-b651-46401ac0b1ad None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:56.196747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148af14-bf05-43e9-b651-46401ac0b1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:56.197026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148af14-bf05-43e9-b651-46401ac0b1ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:56.197858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148af14-bf05-43e9-b651-46401ac0b1ad None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=5b59c5f6dea846b493d978c81d9939eb, user.id=e0a0f3fe4238442594d2add24735dee2) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:16:56.198170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148af14-bf05-43e9-b651-46401ac0b1ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:56.199644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148af14-bf05-43e9-b651-46401ac0b1ad None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:56.206354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 553/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:16:56 2022] GET /identity/v3/role_assignments?user.id=e0a0f3fe4238442594d2add24735dee2&scope.project.id=5b59c5f6dea846b493d978c81d9939eb&role.id=9f557e97d94b4b499a6765419452e1ef => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:58.454113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faec405-21d1-47ab-8222-939ae798c95d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:58.454694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faec405-21d1-47ab-8222-939ae798c95d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:58.454694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faec405-21d1-47ab-8222-939ae798c95d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:58.456037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 554/1107] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:16:58.462428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717594-9ae4-408c-b039-ef0b083939ea None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:58.463187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717594-9ae4-408c-b039-ef0b083939ea None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:58.463317 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717594-9ae4-408c-b039-ef0b083939ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:58.482533 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-35717594-9ae4-408c-b039-ef0b083939ea None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:16:58.483722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-35717594-9ae4-408c-b039-ef0b083939ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:16:58.551882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 554/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:16:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:16:58.576585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faec405-21d1-47ab-8222-939ae798c95d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:58.690354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faec405-21d1-47ab-8222-939ae798c95d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:58.739483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae80bdb-bb04-4ae6-81eb-310d3213af65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:58.740313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae80bdb-bb04-4ae6-81eb-310d3213af65 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:58.740597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae80bdb-bb04-4ae6-81eb-310d3213af65 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:58.740874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae80bdb-bb04-4ae6-81eb-310d3213af65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:58.742058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae80bdb-bb04-4ae6-81eb-310d3213af65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:58.743515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae80bdb-bb04-4ae6-81eb-310d3213af65 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:58.745147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 555/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:16:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:16:58.751223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35717594-9ae4-408c-b039-ef0b083939ea None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:16:58.858657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:16:58.874965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35717594-9ae4-408c-b039-ef0b083939ea None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:16:58.918038 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80a1da-e087-4232-9349-10dc783cf00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:16:58.919120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a1da-e087-4232-9349-10dc783cf00f None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:16:58.919407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a1da-e087-4232-9349-10dc783cf00f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:16:58.919686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a1da-e087-4232-9349-10dc783cf00f None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:16:58.920442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80a1da-e087-4232-9349-10dc783cf00f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:16:58.921913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80a1da-e087-4232-9349-10dc783cf00f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:16:58.948685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 555/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:16:58 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:17:01.213695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da073b3-6c44-49ae-9799-7204c184a9b5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:01.214548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da073b3-6c44-49ae-9799-7204c184a9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:01.214548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da073b3-6c44-49ae-9799-7204c184a9b5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:01.217227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 556/1111] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:01.223510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e4671-443e-4d15-92c7-13e3dc26f383 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:01.223930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e4671-443e-4d15-92c7-13e3dc26f383 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:01.224139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e4671-443e-4d15-92c7-13e3dc26f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:01.249419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f61e4671-443e-4d15-92c7-13e3dc26f383 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:01.250608 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f61e4671-443e-4d15-92c7-13e3dc26f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:01.319650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 556/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:01.343837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da073b3-6c44-49ae-9799-7204c184a9b5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:01.369717 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:01.464787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da073b3-6c44-49ae-9799-7204c184a9b5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:01.500441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8fab6-12b4-457b-b63d-b8f5414eaf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:01.501307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8fab6-12b4-457b-b63d-b8f5414eaf46 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:01.501589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8fab6-12b4-457b-b63d-b8f5414eaf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:01.501865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8fab6-12b4-457b-b63d-b8f5414eaf46 None admin] PATH_INFO: `/v3/roles/f75ffcd78e8b4fb8a4942efdd54e431f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:01.503372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8fab6-12b4-457b-b63d-b8f5414eaf46 None admin] RBAC: Authorizing `identity:get_role(role_id=f75ffcd78e8b4fb8a4942efdd54e431f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:01.504787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8fab6-12b4-457b-b63d-b8f5414eaf46 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:01.506172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 557/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:01 2022] GET /identity/v3/roles/f75ffcd78e8b4fb8a4942efdd54e431f => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:01.514590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e4671-443e-4d15-92c7-13e3dc26f383 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:01.595172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:01.619169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e4671-443e-4d15-92c7-13e3dc26f383 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:01.653293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9e82e-cb20-4239-904a-9c88066abe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:01.654168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9e82e-cb20-4239-904a-9c88066abe9c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:01.654445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9e82e-cb20-4239-904a-9c88066abe9c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:01.654719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9e82e-cb20-4239-904a-9c88066abe9c None admin] PATH_INFO: `/v3/users/cd6354d3a6364b51b34f6a59727e9da0` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:01.668938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9e82e-cb20-4239-904a-9c88066abe9c None admin] RBAC: Authorizing `identity:get_user(user_id=cd6354d3a6364b51b34f6a59727e9da0)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:01.670388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9e82e-cb20-4239-904a-9c88066abe9c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:01.672028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 557/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:01 2022] GET /identity/v3/users/cd6354d3a6364b51b34f6a59727e9da0 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:01.678479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8fab6-12b4-457b-b63d-b8f5414eaf46 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:01.785376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:01.806173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8fab6-12b4-457b-b63d-b8f5414eaf46 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:01.844770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf139d2-34ca-42f4-b9da-fb334b970ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:01.845410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf139d2-34ca-42f4-b9da-fb334b970ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:01.845692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf139d2-34ca-42f4-b9da-fb334b970ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:01.845974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf139d2-34ca-42f4-b9da-fb334b970ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:01.918867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf139d2-34ca-42f4-b9da-fb334b970ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:01.920340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf139d2-34ca-42f4-b9da-fb334b970ac5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:02.009015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:02.030822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 558/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:17:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:17:02.039816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9e82e-cb20-4239-904a-9c88066abe9c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:02.139803 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9e82e-cb20-4239-904a-9c88066abe9c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:02.175661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ff1a4-223a-436e-bbd1-2714f080b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:02.176547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ff1a4-223a-436e-bbd1-2714f080b47e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:02.176828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ff1a4-223a-436e-bbd1-2714f080b47e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:02.177101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ff1a4-223a-436e-bbd1-2714f080b47e None admin] PATH_INFO: `/v3/projects/5b59c5f6dea846b493d978c81d9939eb` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:02.178398 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ff1a4-223a-436e-bbd1-2714f080b47e None admin] RBAC: Authorizing `identity:get_project(project_id=5b59c5f6dea846b493d978c81d9939eb)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:02.179849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ff1a4-223a-436e-bbd1-2714f080b47e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:02.181540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 558/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:17:02 2022] GET /identity/v3/projects/5b59c5f6dea846b493d978c81d9939eb => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:02.187816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf139d2-34ca-42f4-b9da-fb334b970ac5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:02.291105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf139d2-34ca-42f4-b9da-fb334b970ac5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:02.327559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b5709-7f1c-491e-a452-388f96b5bb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:02.328244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b5709-7f1c-491e-a452-388f96b5bb87 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:02.328524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b5709-7f1c-491e-a452-388f96b5bb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:02.328810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b5709-7f1c-491e-a452-388f96b5bb87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:02.329626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b5709-7f1c-491e-a452-388f96b5bb87 None admin] RBAC: Adding query filter params (role.id=f75ffcd78e8b4fb8a4942efdd54e431f, scope.project.id=5b59c5f6dea846b493d978c81d9939eb, user.id=cd6354d3a6364b51b34f6a59727e9da0) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:02.329940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b5709-7f1c-491e-a452-388f96b5bb87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:02.331402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b5709-7f1c-491e-a452-388f96b5bb87 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:02.337019 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 559/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:17:02 2022] GET /identity/v3/role_assignments?user.id=cd6354d3a6364b51b34f6a59727e9da0&scope.project.id=5b59c5f6dea846b493d978c81d9939eb&role.id=f75ffcd78e8b4fb8a4942efdd54e431f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:04.529578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94308b-c7fd-4b18-803a-98073b77664e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:04.530121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94308b-c7fd-4b18-803a-98073b77664e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:04.530121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94308b-c7fd-4b18-803a-98073b77664e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:04.532300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 559/1118] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:04.540316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7d9f-9355-4247-a071-b0525d94950e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:04.540784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7d9f-9355-4247-a071-b0525d94950e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:04.540876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc7d9f-9355-4247-a071-b0525d94950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:04.559744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d3cc7d9f-9355-4247-a071-b0525d94950e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:04.560884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d3cc7d9f-9355-4247-a071-b0525d94950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:04.606619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:04.634058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 560/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:17:04.656810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94308b-c7fd-4b18-803a-98073b77664e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:04.659959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:04.767284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94308b-c7fd-4b18-803a-98073b77664e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:04.802724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cb929-12e1-4313-ba60-be4fda8baa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:04.803579 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cb929-12e1-4313-ba60-be4fda8baa43 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:04.803860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cb929-12e1-4313-ba60-be4fda8baa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:04.804158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cb929-12e1-4313-ba60-be4fda8baa43 None admin] PATH_INFO: `/v3/roles/f75ffcd78e8b4fb8a4942efdd54e431f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:04.805742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cb929-12e1-4313-ba60-be4fda8baa43 None admin] RBAC: Authorizing `identity:get_role(role_id=f75ffcd78e8b4fb8a4942efdd54e431f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:04.807125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cb929-12e1-4313-ba60-be4fda8baa43 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:04.808504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 560/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:04 2022] GET /identity/v3/roles/f75ffcd78e8b4fb8a4942efdd54e431f => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:04.818135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc7d9f-9355-4247-a071-b0525d94950e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:04.922890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc7d9f-9355-4247-a071-b0525d94950e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:04.959086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c327789-c236-4721-9389-2418b3349dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:04.959961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c327789-c236-4721-9389-2418b3349dba None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:04.960279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c327789-c236-4721-9389-2418b3349dba None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:04.960555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c327789-c236-4721-9389-2418b3349dba None admin] PATH_INFO: `/v3/users/cd6354d3a6364b51b34f6a59727e9da0` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:04.961836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c327789-c236-4721-9389-2418b3349dba None admin] RBAC: Authorizing `identity:get_user(user_id=cd6354d3a6364b51b34f6a59727e9da0)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:04.963307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c327789-c236-4721-9389-2418b3349dba None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:04.965172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 561/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:04 2022] GET /identity/v3/users/cd6354d3a6364b51b34f6a59727e9da0 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:04.971783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cb929-12e1-4313-ba60-be4fda8baa43 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:05.060677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:05.102144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cb929-12e1-4313-ba60-be4fda8baa43 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:05.140032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834fd6c-c762-4210-ba99-293795bade26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:05.144134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834fd6c-c762-4210-ba99-293795bade26 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:05.144423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834fd6c-c762-4210-ba99-293795bade26 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:05.144706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834fd6c-c762-4210-ba99-293795bade26 None admin] PATH_INFO: `/v3/projects/5b59c5f6dea846b493d978c81d9939eb` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:05.146964 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834fd6c-c762-4210-ba99-293795bade26 None admin] RBAC: Authorizing `identity:get_project(project_id=5b59c5f6dea846b493d978c81d9939eb)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:05.148478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834fd6c-c762-4210-ba99-293795bade26 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:05.150186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 561/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:17:04 2022] GET /identity/v3/projects/5b59c5f6dea846b493d978c81d9939eb => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:05.156785 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c327789-c236-4721-9389-2418b3349dba None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:05.218856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:05.277209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c327789-c236-4721-9389-2418b3349dba None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:05.313120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b2c2b-e729-4a45-81cb-859af3bb00fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:05.314017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2c2b-e729-4a45-81cb-859af3bb00fb None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:05.314304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2c2b-e729-4a45-81cb-859af3bb00fb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:05.314578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2c2b-e729-4a45-81cb-859af3bb00fb None admin] PATH_INFO: `/v3/projects/5b59c5f6dea846b493d978c81d9939eb/users/cd6354d3a6364b51b34f6a59727e9da0/roles/f75ffcd78e8b4fb8a4942efdd54e431f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:05.317020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b2c2b-e729-4a45-81cb-859af3bb00fb None admin] RBAC: Authorizing `identity:create_grant(project_id=5b59c5f6dea846b493d978c81d9939eb, user_id=cd6354d3a6364b51b34f6a59727e9da0, role_id=f75ffcd78e8b4fb8a4942efdd54e431f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:05.318463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b2c2b-e729-4a45-81cb-859af3bb00fb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:05.334626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 562/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:17:05 2022] PUT /identity/v3/projects/5b59c5f6dea846b493d978c81d9939eb/users/cd6354d3a6364b51b34f6a59727e9da0/roles/f75ffcd78e8b4fb8a4942efdd54e431f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:17:07.587253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45b8bf-7a3a-4e87-be0b-22a0c9636aec None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:07.588134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45b8bf-7a3a-4e87-be0b-22a0c9636aec None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:07.588134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45b8bf-7a3a-4e87-be0b-22a0c9636aec None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:07.590317 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 562/1124] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:07.599142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629e126-3346-4f66-afac-bd08e8b6c902 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:07.599556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629e126-3346-4f66-afac-bd08e8b6c902 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:07.599738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629e126-3346-4f66-afac-bd08e8b6c902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:07.619980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d629e126-3346-4f66-afac-bd08e8b6c902 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:07.621195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d629e126-3346-4f66-afac-bd08e8b6c902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:07.691009 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 563/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:07.715939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45b8bf-7a3a-4e87-be0b-22a0c9636aec None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:07.828214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45b8bf-7a3a-4e87-be0b-22a0c9636aec None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:07.864926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4fabb-079e-4b83-8fea-2a65b2a7e895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:07.866073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4fabb-079e-4b83-8fea-2a65b2a7e895 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:07.866443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4fabb-079e-4b83-8fea-2a65b2a7e895 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:07.866799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4fabb-079e-4b83-8fea-2a65b2a7e895 None admin] PATH_INFO: `/v3/roles/f75ffcd78e8b4fb8a4942efdd54e431f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:07.869463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4fabb-079e-4b83-8fea-2a65b2a7e895 None admin] RBAC: Authorizing `identity:get_role(role_id=f75ffcd78e8b4fb8a4942efdd54e431f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:07.871638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4fabb-079e-4b83-8fea-2a65b2a7e895 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:07.874130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 563/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:07 2022] GET /identity/v3/roles/f75ffcd78e8b4fb8a4942efdd54e431f => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:07.883305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629e126-3346-4f66-afac-bd08e8b6c902 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:07.920845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:07.988034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629e126-3346-4f66-afac-bd08e8b6c902 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:08.023589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95319799-8eb0-4bca-91d2-822e0acca0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:08.024476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95319799-8eb0-4bca-91d2-822e0acca0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:08.024751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95319799-8eb0-4bca-91d2-822e0acca0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:08.025021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95319799-8eb0-4bca-91d2-822e0acca0a6 None admin] PATH_INFO: `/v3/users/cd6354d3a6364b51b34f6a59727e9da0` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:08.026447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95319799-8eb0-4bca-91d2-822e0acca0a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cd6354d3a6364b51b34f6a59727e9da0)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:08.027995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95319799-8eb0-4bca-91d2-822e0acca0a6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:08.029821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 564/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:07 2022] GET /identity/v3/users/cd6354d3a6364b51b34f6a59727e9da0 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:08.039017 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4fabb-079e-4b83-8fea-2a65b2a7e895 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:08.053732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:08.153075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4fabb-079e-4b83-8fea-2a65b2a7e895 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:08.193150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde9e7a-2f6f-4e12-a5ea-75114c9cb072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:08.193796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde9e7a-2f6f-4e12-a5ea-75114c9cb072 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:08.194083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde9e7a-2f6f-4e12-a5ea-75114c9cb072 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:08.194357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde9e7a-2f6f-4e12-a5ea-75114c9cb072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:08.266028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde9e7a-2f6f-4e12-a5ea-75114c9cb072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:08.267491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde9e7a-2f6f-4e12-a5ea-75114c9cb072 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:08.275153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:08.371822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 564/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:17:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:17:08.378342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95319799-8eb0-4bca-91d2-822e0acca0a6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:08.485340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95319799-8eb0-4bca-91d2-822e0acca0a6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:08.486861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:08.522033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e0f5-20af-4d1c-b391-1d425e3046d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:08.522924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e0f5-20af-4d1c-b391-1d425e3046d2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:08.523205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e0f5-20af-4d1c-b391-1d425e3046d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:08.523482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e0f5-20af-4d1c-b391-1d425e3046d2 None admin] PATH_INFO: `/v3/projects/5b59c5f6dea846b493d978c81d9939eb` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:08.524754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226e0f5-20af-4d1c-b391-1d425e3046d2 None admin] RBAC: Authorizing `identity:get_project(project_id=5b59c5f6dea846b493d978c81d9939eb)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:08.526206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226e0f5-20af-4d1c-b391-1d425e3046d2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:08.528093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 565/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:17:08 2022] GET /identity/v3/projects/5b59c5f6dea846b493d978c81d9939eb => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:08.538324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde9e7a-2f6f-4e12-a5ea-75114c9cb072 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:08.640511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde9e7a-2f6f-4e12-a5ea-75114c9cb072 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:08.647660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:08.677188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c7195-1254-4537-81a6-7fc935706da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:08.677843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c7195-1254-4537-81a6-7fc935706da6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:08.678124 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c7195-1254-4537-81a6-7fc935706da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:08.678400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c7195-1254-4537-81a6-7fc935706da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:08.679235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c7195-1254-4537-81a6-7fc935706da6 None admin] RBAC: Adding query filter params (role.id=f75ffcd78e8b4fb8a4942efdd54e431f, scope.project.id=5b59c5f6dea846b493d978c81d9939eb, user.id=cd6354d3a6364b51b34f6a59727e9da0) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:08.679547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c7195-1254-4537-81a6-7fc935706da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:08.681029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c7195-1254-4537-81a6-7fc935706da6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:08.687339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 565/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:17:08 2022] GET /identity/v3/role_assignments?user.id=cd6354d3a6364b51b34f6a59727e9da0&scope.project.id=5b59c5f6dea846b493d978c81d9939eb&role.id=f75ffcd78e8b4fb8a4942efdd54e431f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:10.928270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f78284-9f96-49ac-85df-abf7de0be3d6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:10.928836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f78284-9f96-49ac-85df-abf7de0be3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:10.928836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f78284-9f96-49ac-85df-abf7de0be3d6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:10.930210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 566/1131] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:10.936743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f38e1-8fdf-42c8-ad33-5ca31dde9be4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:10.937414 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f38e1-8fdf-42c8-ad33-5ca31dde9be4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:10.937606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f38e1-8fdf-42c8-ad33-5ca31dde9be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:10.966374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fe1f38e1-8fdf-42c8-ad33-5ca31dde9be4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:10.967560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fe1f38e1-8fdf-42c8-ad33-5ca31dde9be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:11.040040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 566/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:11.064116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f78284-9f96-49ac-85df-abf7de0be3d6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:11.171775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f78284-9f96-49ac-85df-abf7de0be3d6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:11.207146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40bbef-5834-443c-991e-01a16403ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:11.207863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40bbef-5834-443c-991e-01a16403ea88 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:11.208171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40bbef-5834-443c-991e-01a16403ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:11.208439 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40bbef-5834-443c-991e-01a16403ea88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:11.209636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40bbef-5834-443c-991e-01a16403ea88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:11.211085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40bbef-5834-443c-991e-01a16403ea88 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:11.212694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 567/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:17:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:11.219003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f38e1-8fdf-42c8-ad33-5ca31dde9be4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:11.323860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:11.327365 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f38e1-8fdf-42c8-ad33-5ca31dde9be4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:11.361827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b06696-17af-4771-a813-eec53d811947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:11.362487 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b06696-17af-4771-a813-eec53d811947 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:11.362769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b06696-17af-4771-a813-eec53d811947 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:11.363044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b06696-17af-4771-a813-eec53d811947 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:11.363757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b06696-17af-4771-a813-eec53d811947 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:11.365256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b06696-17af-4771-a813-eec53d811947 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:11.394876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 567/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:17:11 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:17:13.634619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fa662-46e0-4b78-8703-debe912e932e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:13.635164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fa662-46e0-4b78-8703-debe912e932e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:13.635164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fa662-46e0-4b78-8703-debe912e932e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:13.636514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 568/1135] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:13.642867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f7628-e609-4bc1-bd10-759ca70a22b0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:13.643559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f7628-e609-4bc1-bd10-759ca70a22b0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:13.643743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f7628-e609-4bc1-bd10-759ca70a22b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:13.670965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-811f7628-e609-4bc1-bd10-759ca70a22b0 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:13.672191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-811f7628-e609-4bc1-bd10-759ca70a22b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:13.742730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 568/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:13.775441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fa662-46e0-4b78-8703-debe912e932e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:13.818226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:13.879849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fa662-46e0-4b78-8703-debe912e932e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:13.915305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3e433-5440-4ae0-b388-510c43110850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:13.916043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e433-5440-4ae0-b388-510c43110850 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:13.916322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e433-5440-4ae0-b388-510c43110850 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:13.916593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e433-5440-4ae0-b388-510c43110850 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:13.918206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3e433-5440-4ae0-b388-510c43110850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:13.919673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3e433-5440-4ae0-b388-510c43110850 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:13.921298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 569/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:13.930396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f7628-e609-4bc1-bd10-759ca70a22b0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:14.014752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:14.033910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f7628-e609-4bc1-bd10-759ca70a22b0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:14.071839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e8e60-d433-4203-8d23-dca0a659ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:14.072903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e8e60-d433-4203-8d23-dca0a659ff87 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:14.073328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e8e60-d433-4203-8d23-dca0a659ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:14.073729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e8e60-d433-4203-8d23-dca0a659ff87 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:14.074788 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e8e60-d433-4203-8d23-dca0a659ff87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:14.077240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e8e60-d433-4203-8d23-dca0a659ff87 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:14.105613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 569/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:17:13 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:17:16.338267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae6706-1117-46b9-83cd-76af7253dc5e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:16.338843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae6706-1117-46b9-83cd-76af7253dc5e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:16.338843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae6706-1117-46b9-83cd-76af7253dc5e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:16.340294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 570/1139] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:16.346593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8b69-2cf5-43a6-830f-9d5bf9b314c3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:16.347037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8b69-2cf5-43a6-830f-9d5bf9b314c3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:16.347224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8b69-2cf5-43a6-830f-9d5bf9b314c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:16.367806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d25c8b69-2cf5-43a6-830f-9d5bf9b314c3 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:16.369044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d25c8b69-2cf5-43a6-830f-9d5bf9b314c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:16.449171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 570/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:16.479830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae6706-1117-46b9-83cd-76af7253dc5e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:16.591524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae6706-1117-46b9-83cd-76af7253dc5e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:16.598723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:16.632204 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1c735-fdb7-4c1b-b085-03f27bf1bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:16.632996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1c735-fdb7-4c1b-b085-03f27bf1bc68 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:16.633281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1c735-fdb7-4c1b-b085-03f27bf1bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:16.633557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1c735-fdb7-4c1b-b085-03f27bf1bc68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:16.644703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1c735-fdb7-4c1b-b085-03f27bf1bc68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4bd1c735-fdb7-4c1b-b085-03f27bf1bc68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:17:16.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:17:16.653398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:17:16.655602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 571/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:17:16.663554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c8b69-2cf5-43a6-830f-9d5bf9b314c3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:16.735218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:16.782627 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c8b69-2cf5-43a6-830f-9d5bf9b314c3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:16.819480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144449a-be79-43b9-9a33-0cd8275ae491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:16.820177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144449a-be79-43b9-9a33-0cd8275ae491 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:16.820460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144449a-be79-43b9-9a33-0cd8275ae491 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:16.820733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144449a-be79-43b9-9a33-0cd8275ae491 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:16.821485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144449a-be79-43b9-9a33-0cd8275ae491 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:16.821793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144449a-be79-43b9-9a33-0cd8275ae491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:16.823182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144449a-be79-43b9-9a33-0cd8275ae491 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:16.832132 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 571/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:17:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:16.841353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1c735-fdb7-4c1b-b085-03f27bf1bc68 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:16.950250 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1c735-fdb7-4c1b-b085-03f27bf1bc68 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:16.987663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35aa30-10e2-4101-accc-7eb5fb7faf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:16.989075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35aa30-10e2-4101-accc-7eb5fb7faf1b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:16.989549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35aa30-10e2-4101-accc-7eb5fb7faf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:16.990009 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35aa30-10e2-4101-accc-7eb5fb7faf1b None admin] PATH_INFO: `/v3/users/a229117ff37f4a63a5a4ba049cc5d711` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:17.007249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35aa30-10e2-4101-accc-7eb5fb7faf1b None admin] RBAC: Authorizing `identity:get_user(user_id=a229117ff37f4a63a5a4ba049cc5d711)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:17.008764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35aa30-10e2-4101-accc-7eb5fb7faf1b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:17.010485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 572/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:16 2022] GET /identity/v3/users/a229117ff37f4a63a5a4ba049cc5d711 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:17.017625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144449a-be79-43b9-9a33-0cd8275ae491 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:17.126494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144449a-be79-43b9-9a33-0cd8275ae491 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:17.155120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:17.161760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e4d51-2e2f-4ce3-8013-94a2e6e1bc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:17.162409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e4d51-2e2f-4ce3-8013-94a2e6e1bc8f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:17.162687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e4d51-2e2f-4ce3-8013-94a2e6e1bc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:17.162961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e4d51-2e2f-4ce3-8013-94a2e6e1bc8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:17.233200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e4d51-2e2f-4ce3-8013-94a2e6e1bc8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:17.234589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e4d51-2e2f-4ce3-8013-94a2e6e1bc8f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:17.337448 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 572/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:17:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:17:17.344468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35aa30-10e2-4101-accc-7eb5fb7faf1b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:17.377337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:17.455854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35aa30-10e2-4101-accc-7eb5fb7faf1b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:17.491444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9816276-2247-45b6-9347-33b914997f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:17.492265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9816276-2247-45b6-9347-33b914997f14 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:17.492544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9816276-2247-45b6-9347-33b914997f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:17.492821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9816276-2247-45b6-9347-33b914997f14 None admin] PATH_INFO: `/v3/projects/d68d6d6b1af746499c635e8a7d05e405` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:17.494032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9816276-2247-45b6-9347-33b914997f14 None admin] RBAC: Authorizing `identity:get_project(project_id=d68d6d6b1af746499c635e8a7d05e405)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:17.495488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9816276-2247-45b6-9347-33b914997f14 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:17.497519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 573/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:17:17 2022] GET /identity/v3/projects/d68d6d6b1af746499c635e8a7d05e405 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:17.507636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e4d51-2e2f-4ce3-8013-94a2e6e1bc8f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:17.545022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:17.615917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e4d51-2e2f-4ce3-8013-94a2e6e1bc8f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:17.654717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e96af5-8f1a-4a70-b46a-a928d95ee996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:17.655367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e96af5-8f1a-4a70-b46a-a928d95ee996 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:17.655647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e96af5-8f1a-4a70-b46a-a928d95ee996 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:17.655927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e96af5-8f1a-4a70-b46a-a928d95ee996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:17.656793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e96af5-8f1a-4a70-b46a-a928d95ee996 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=d68d6d6b1af746499c635e8a7d05e405, user.id=a229117ff37f4a63a5a4ba049cc5d711) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:17.657105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e96af5-8f1a-4a70-b46a-a928d95ee996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:17.658571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e96af5-8f1a-4a70-b46a-a928d95ee996 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:17.664351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 573/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:17:17 2022] GET /identity/v3/role_assignments?user.id=a229117ff37f4a63a5a4ba049cc5d711&scope.project.id=d68d6d6b1af746499c635e8a7d05e405&role.id=9f557e97d94b4b499a6765419452e1ef => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:19.901269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6c4f5-2b28-48f7-a485-b3a33a32a3f6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:19.901855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6c4f5-2b28-48f7-a485-b3a33a32a3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:19.901855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6c4f5-2b28-48f7-a485-b3a33a32a3f6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:19.903889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 574/1147] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:19.909388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f64be-ce13-43fe-a45b-ef1e42b88c2d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:19.909806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f64be-ce13-43fe-a45b-ef1e42b88c2d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:19.909915 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f64be-ce13-43fe-a45b-ef1e42b88c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:19.930157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-281f64be-ce13-43fe-a45b-ef1e42b88c2d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:19.931353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-281f64be-ce13-43fe-a45b-ef1e42b88c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:20.006163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 574/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:20.029640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6c4f5-2b28-48f7-a485-b3a33a32a3f6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:20.139678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:20.150691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6c4f5-2b28-48f7-a485-b3a33a32a3f6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:20.185771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0b075-7412-43dc-9744-dcb26c794ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:20.186555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0b075-7412-43dc-9744-dcb26c794ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:20.186834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0b075-7412-43dc-9744-dcb26c794ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:20.187107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0b075-7412-43dc-9744-dcb26c794ac9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:20.198059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0b075-7412-43dc-9744-dcb26c794ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5cd0b075-7412-43dc-9744-dcb26c794ac9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:17:20.205672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:17:20.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:17:20.207555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 575/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:17:20.213020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f64be-ce13-43fe-a45b-ef1e42b88c2d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:20.238019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:20.325427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f64be-ce13-43fe-a45b-ef1e42b88c2d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:20.362738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8334a0-66cf-4369-a9e8-7eaf440f93a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:20.363413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8334a0-66cf-4369-a9e8-7eaf440f93a9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:20.363695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8334a0-66cf-4369-a9e8-7eaf440f93a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:20.363976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8334a0-66cf-4369-a9e8-7eaf440f93a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:20.364773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8334a0-66cf-4369-a9e8-7eaf440f93a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:20.365084 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8334a0-66cf-4369-a9e8-7eaf440f93a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:20.366483 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8334a0-66cf-4369-a9e8-7eaf440f93a9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:20.374776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 575/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:20.384169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0b075-7412-43dc-9744-dcb26c794ac9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:20.505179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0b075-7412-43dc-9744-dcb26c794ac9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:20.547002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302eb490-9327-4d19-ad9f-c32121db195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:20.547891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb490-9327-4d19-ad9f-c32121db195b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:20.548210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb490-9327-4d19-ad9f-c32121db195b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:20.548490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eb490-9327-4d19-ad9f-c32121db195b None admin] PATH_INFO: `/v3/users/a229117ff37f4a63a5a4ba049cc5d711` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:20.549730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302eb490-9327-4d19-ad9f-c32121db195b None admin] RBAC: Authorizing `identity:get_user(user_id=a229117ff37f4a63a5a4ba049cc5d711)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:20.551193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302eb490-9327-4d19-ad9f-c32121db195b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:20.552878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 576/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:20 2022] GET /identity/v3/users/a229117ff37f4a63a5a4ba049cc5d711 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:20.558970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8334a0-66cf-4369-a9e8-7eaf440f93a9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:20.649236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:20.666061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8334a0-66cf-4369-a9e8-7eaf440f93a9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:20.707163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c7e8-cc9f-4a40-bad3-112afbc56789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:20.708440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c7e8-cc9f-4a40-bad3-112afbc56789 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:20.708847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c7e8-cc9f-4a40-bad3-112afbc56789 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:20.709256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c7e8-cc9f-4a40-bad3-112afbc56789 None admin] PATH_INFO: `/v3/projects/d68d6d6b1af746499c635e8a7d05e405` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:20.711351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1c7e8-cc9f-4a40-bad3-112afbc56789 None admin] RBAC: Authorizing `identity:get_project(project_id=d68d6d6b1af746499c635e8a7d05e405)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:20.713699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1c7e8-cc9f-4a40-bad3-112afbc56789 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:20.716308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 576/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:17:20 2022] GET /identity/v3/projects/d68d6d6b1af746499c635e8a7d05e405 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:20.722347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302eb490-9327-4d19-ad9f-c32121db195b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:20.746709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:20.832038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302eb490-9327-4d19-ad9f-c32121db195b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:20.869272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f234e12-bcc6-47f0-a7fd-7e58a62c59b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:20.870150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f234e12-bcc6-47f0-a7fd-7e58a62c59b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:20.870424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f234e12-bcc6-47f0-a7fd-7e58a62c59b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:20.870692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f234e12-bcc6-47f0-a7fd-7e58a62c59b9 None admin] PATH_INFO: `/v3/projects/d68d6d6b1af746499c635e8a7d05e405/users/a229117ff37f4a63a5a4ba049cc5d711/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:20.873174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f234e12-bcc6-47f0-a7fd-7e58a62c59b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d68d6d6b1af746499c635e8a7d05e405, user_id=a229117ff37f4a63a5a4ba049cc5d711, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:20.874610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f234e12-bcc6-47f0-a7fd-7e58a62c59b9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:20.891178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 577/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:17:20 2022] PUT /identity/v3/projects/d68d6d6b1af746499c635e8a7d05e405/users/a229117ff37f4a63a5a4ba049cc5d711/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:17:23.079961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0e92f-9ea5-4b71-9075-74c0d225e652 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:23.080965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0e92f-9ea5-4b71-9075-74c0d225e652 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:23.080965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0e92f-9ea5-4b71-9075-74c0d225e652 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:23.083072 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 577/1154] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:23.091604 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692e1b9-d409-4eec-91a4-f1ffc8820018 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:23.092067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692e1b9-d409-4eec-91a4-f1ffc8820018 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:23.092178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692e1b9-d409-4eec-91a4-f1ffc8820018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:23.110684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e692e1b9-d409-4eec-91a4-f1ffc8820018 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:23.111897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e692e1b9-d409-4eec-91a4-f1ffc8820018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:23.184776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 578/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:23.209045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0e92f-9ea5-4b71-9075-74c0d225e652 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:23.333697 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0e92f-9ea5-4b71-9075-74c0d225e652 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:23.367726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4b24-8078-4674-a726-ee5e4654b6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:23.368582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4b24-8078-4674-a726-ee5e4654b6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:23.368866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4b24-8078-4674-a726-ee5e4654b6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:23.369144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4b24-8078-4674-a726-ee5e4654b6f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:23.380493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a4b24-8078-4674-a726-ee5e4654b6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1c9a4b24-8078-4674-a726-ee5e4654b6f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:17:23.388464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:17:23.389559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:17:23.390528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 578/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:17:23.396030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692e1b9-d409-4eec-91a4-f1ffc8820018 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:23.409253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:23.501714 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692e1b9-d409-4eec-91a4-f1ffc8820018 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:23.535873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433ded9-aefd-4753-947d-64f469af1908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:23.536549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433ded9-aefd-4753-947d-64f469af1908 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:23.536828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433ded9-aefd-4753-947d-64f469af1908 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:23.537096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433ded9-aefd-4753-947d-64f469af1908 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:23.537834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433ded9-aefd-4753-947d-64f469af1908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:23.538141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433ded9-aefd-4753-947d-64f469af1908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:23.539521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433ded9-aefd-4753-947d-64f469af1908 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:23.548398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 579/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:17:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:23.554884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4b24-8078-4674-a726-ee5e4654b6f7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:23.578514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:23.670832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4b24-8078-4674-a726-ee5e4654b6f7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:23.708083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab335c-696f-4e59-bdbb-39745083381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:23.709102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab335c-696f-4e59-bdbb-39745083381d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:23.709387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab335c-696f-4e59-bdbb-39745083381d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:23.709662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab335c-696f-4e59-bdbb-39745083381d None admin] PATH_INFO: `/v3/users/a229117ff37f4a63a5a4ba049cc5d711` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:23.710913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab335c-696f-4e59-bdbb-39745083381d None admin] RBAC: Authorizing `identity:get_user(user_id=a229117ff37f4a63a5a4ba049cc5d711)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:23.712432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab335c-696f-4e59-bdbb-39745083381d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:23.714077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 579/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:23 2022] GET /identity/v3/users/a229117ff37f4a63a5a4ba049cc5d711 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:23.720961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433ded9-aefd-4753-947d-64f469af1908 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:23.804925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:23.849196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433ded9-aefd-4753-947d-64f469af1908 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:23.886934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb95d-5c6c-4530-b8c0-5119772755b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:23.887600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb95d-5c6c-4530-b8c0-5119772755b5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:23.887931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb95d-5c6c-4530-b8c0-5119772755b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:23.888173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bb95d-5c6c-4530-b8c0-5119772755b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:23.964461 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bb95d-5c6c-4530-b8c0-5119772755b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:23.966037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bb95d-5c6c-4530-b8c0-5119772755b5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:24.033463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:24.070572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 580/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:17:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:17:24.077388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab335c-696f-4e59-bdbb-39745083381d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:24.162900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:24.182809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab335c-696f-4e59-bdbb-39745083381d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:24.219699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3212b-6c17-4469-959f-e71e168c0482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:24.220524 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3212b-6c17-4469-959f-e71e168c0482 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:24.220804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3212b-6c17-4469-959f-e71e168c0482 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:24.221080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3212b-6c17-4469-959f-e71e168c0482 None admin] PATH_INFO: `/v3/projects/d68d6d6b1af746499c635e8a7d05e405` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:24.222318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3212b-6c17-4469-959f-e71e168c0482 None admin] RBAC: Authorizing `identity:get_project(project_id=d68d6d6b1af746499c635e8a7d05e405)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:24.223761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3212b-6c17-4469-959f-e71e168c0482 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:24.225465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 580/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:17:24 2022] GET /identity/v3/projects/d68d6d6b1af746499c635e8a7d05e405 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:24.234055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb95d-5c6c-4530-b8c0-5119772755b5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:24.346835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bb95d-5c6c-4530-b8c0-5119772755b5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:24.382637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b959561-7fd1-4403-b54f-d447b5f5a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:24.383580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959561-7fd1-4403-b54f-d447b5f5a538 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:24.383972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959561-7fd1-4403-b54f-d447b5f5a538 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:24.384406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b959561-7fd1-4403-b54f-d447b5f5a538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:24.385691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b959561-7fd1-4403-b54f-d447b5f5a538 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=d68d6d6b1af746499c635e8a7d05e405, user.id=a229117ff37f4a63a5a4ba049cc5d711) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:24.386217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b959561-7fd1-4403-b54f-d447b5f5a538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:24.389189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b959561-7fd1-4403-b54f-d447b5f5a538 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:24.399166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 581/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:17:24 2022] GET /identity/v3/role_assignments?user.id=a229117ff37f4a63a5a4ba049cc5d711&scope.project.id=d68d6d6b1af746499c635e8a7d05e405&role.id=9f557e97d94b4b499a6765419452e1ef => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:26.626973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e967f-8c4a-4c1f-87b3-80478d2baa10 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:26.627774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e967f-8c4a-4c1f-87b3-80478d2baa10 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:26.627774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e967f-8c4a-4c1f-87b3-80478d2baa10 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:26.629969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 581/1162] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:26.635521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93129c55-1d18-43fc-9f5e-6579dfeb0d5d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:26.635952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93129c55-1d18-43fc-9f5e-6579dfeb0d5d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:26.636081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93129c55-1d18-43fc-9f5e-6579dfeb0d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:26.655321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-93129c55-1d18-43fc-9f5e-6579dfeb0d5d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:26.656518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-93129c55-1d18-43fc-9f5e-6579dfeb0d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:26.688437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:26.738332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 582/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:26.761348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e967f-8c4a-4c1f-87b3-80478d2baa10 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:26.868223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e967f-8c4a-4c1f-87b3-80478d2baa10 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:26.903502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b2f07-0b4f-4961-878e-d49b6bcb72c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:26.904101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b2f07-0b4f-4961-878e-d49b6bcb72c7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:26.904392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b2f07-0b4f-4961-878e-d49b6bcb72c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:26.904661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b2f07-0b4f-4961-878e-d49b6bcb72c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:26.923493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:26.973713 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b2f07-0b4f-4961-878e-d49b6bcb72c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:26.975185 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b2f07-0b4f-4961-878e-d49b6bcb72c7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:27.076265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 582/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:17:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:17:27.082659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93129c55-1d18-43fc-9f5e-6579dfeb0d5d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:27.185810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93129c55-1d18-43fc-9f5e-6579dfeb0d5d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:27.221207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489b770-ec5d-434b-ae34-a65b0e078e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:27.222004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b770-ec5d-434b-ae34-a65b0e078e0d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:27.222284 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b770-ec5d-434b-ae34-a65b0e078e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:27.222557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b770-ec5d-434b-ae34-a65b0e078e0d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:27.229515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489b770-ec5d-434b-ae34-a65b0e078e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:27.231031 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489b770-ec5d-434b-ae34-a65b0e078e0d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e489b770-ec5d-434b-ae34-a65b0e078e0d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:17:27.245868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:17:27.246997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:17:27.247852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 583/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 4 18:17:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:17:27.253996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b2f07-0b4f-4961-878e-d49b6bcb72c7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:27.313152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:27.364833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b2f07-0b4f-4961-878e-d49b6bcb72c7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:27.406387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bc401-4a03-4ae2-8da5-6bd2813ad24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:27.407053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bc401-4a03-4ae2-8da5-6bd2813ad24e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:27.407338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bc401-4a03-4ae2-8da5-6bd2813ad24e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:27.407610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bc401-4a03-4ae2-8da5-6bd2813ad24e None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:27.408374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bc401-4a03-4ae2-8da5-6bd2813ad24e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:27.408683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bc401-4a03-4ae2-8da5-6bd2813ad24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:27.410064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bc401-4a03-4ae2-8da5-6bd2813ad24e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:27.417758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 583/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Sat Jun 4 18:17:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:29.680980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2a6f8-005b-4571-9e7f-749a5bc53dfa None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:29.681849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2a6f8-005b-4571-9e7f-749a5bc53dfa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:29.681941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2a6f8-005b-4571-9e7f-749a5bc53dfa None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:29.684201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 584/1167] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:29.690115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3696c8-1871-4e67-98f2-a6aed808a312 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:29.690545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3696c8-1871-4e67-98f2-a6aed808a312 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:29.690649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3696c8-1871-4e67-98f2-a6aed808a312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:29.708041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ae3696c8-1871-4e67-98f2-a6aed808a312 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:29.709260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ae3696c8-1871-4e67-98f2-a6aed808a312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:29.779915 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 584/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:29.809897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2a6f8-005b-4571-9e7f-749a5bc53dfa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:29.841111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:29.933787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2a6f8-005b-4571-9e7f-749a5bc53dfa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:29.972418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86be6cb-a7f4-4c70-905b-fd52d90ba2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:29.973067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be6cb-a7f4-4c70-905b-fd52d90ba2a7 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:29.973348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be6cb-a7f4-4c70-905b-fd52d90ba2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:29.973617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be6cb-a7f4-4c70-905b-fd52d90ba2a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:29.974356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86be6cb-a7f4-4c70-905b-fd52d90ba2a7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:29.975737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86be6cb-a7f4-4c70-905b-fd52d90ba2a7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:29.993475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 585/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Sat Jun 4 18:17:29 2022] POST /identity/v3/domains => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:17:32.223259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcc94b-682e-4770-8cd3-ef16af273d58 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:32.223853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcc94b-682e-4770-8cd3-ef16af273d58 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:32.223853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcc94b-682e-4770-8cd3-ef16af273d58 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:32.225209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 585/1170] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:32.231751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43892aeb-dbb6-4347-9460-6e36596ed67c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:32.232513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43892aeb-dbb6-4347-9460-6e36596ed67c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:32.232968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43892aeb-dbb6-4347-9460-6e36596ed67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:32.256121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-43892aeb-dbb6-4347-9460-6e36596ed67c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:32.257313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-43892aeb-dbb6-4347-9460-6e36596ed67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:32.343145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 586/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:32.367105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcc94b-682e-4770-8cd3-ef16af273d58 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:32.415175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:32.488626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcc94b-682e-4770-8cd3-ef16af273d58 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:32.523455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a935aad-0e56-4d00-b2b3-11a469ef8e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:32.524345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a935aad-0e56-4d00-b2b3-11a469ef8e33 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:32.524603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a935aad-0e56-4d00-b2b3-11a469ef8e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:32.524872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a935aad-0e56-4d00-b2b3-11a469ef8e33 None admin] PATH_INFO: `/v3/domains/afdfa4b354cb400faca779ada2819b1a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:32.535939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a935aad-0e56-4d00-b2b3-11a469ef8e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=afdfa4b354cb400faca779ada2819b1a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:32.537443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a935aad-0e56-4d00-b2b3-11a469ef8e33 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:32.539052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 586/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Sat Jun 4 18:17:32 2022] GET /identity/v3/domains/afdfa4b354cb400faca779ada2819b1a => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:32.545825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43892aeb-dbb6-4347-9460-6e36596ed67c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:32.566667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:32.663129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43892aeb-dbb6-4347-9460-6e36596ed67c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:32.702976 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e00a1d-ae92-426d-9880-24aabccd3b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:32.703639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00a1d-ae92-426d-9880-24aabccd3b49 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:32.703929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00a1d-ae92-426d-9880-24aabccd3b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:32.704238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00a1d-ae92-426d-9880-24aabccd3b49 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:32.704956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00a1d-ae92-426d-9880-24aabccd3b49 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:32.706426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00a1d-ae92-426d-9880-24aabccd3b49 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:32.739039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 587/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:17:32 2022] POST /identity/v3/projects => generated 361 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:17:35.000296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aae26a-61d6-4dcc-8f96-0d90cf9f621a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:35.000891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aae26a-61d6-4dcc-8f96-0d90cf9f621a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:35.000891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aae26a-61d6-4dcc-8f96-0d90cf9f621a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:35.002206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 587/1174] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:35.008784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb030c-a58a-4b57-b209-a116be2c5536 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:35.009497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb030c-a58a-4b57-b209-a116be2c5536 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:35.009634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb030c-a58a-4b57-b209-a116be2c5536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:35.035037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-60fb030c-a58a-4b57-b209-a116be2c5536 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:35.036267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-60fb030c-a58a-4b57-b209-a116be2c5536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:35.102898 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:35.110880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 588/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:35.138258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aae26a-61d6-4dcc-8f96-0d90cf9f621a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:35.250645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aae26a-61d6-4dcc-8f96-0d90cf9f621a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:35.252928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:35.286133 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125aff0-e18b-4183-93d0-2dfa0ba53257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:35.287045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125aff0-e18b-4183-93d0-2dfa0ba53257 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:35.287328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125aff0-e18b-4183-93d0-2dfa0ba53257 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:35.287598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125aff0-e18b-4183-93d0-2dfa0ba53257 None admin] PATH_INFO: `/v3/domains/afdfa4b354cb400faca779ada2819b1a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:35.288978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125aff0-e18b-4183-93d0-2dfa0ba53257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=afdfa4b354cb400faca779ada2819b1a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:35.290482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125aff0-e18b-4183-93d0-2dfa0ba53257 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:35.292521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 588/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Sat Jun 4 18:17:35 2022] GET /identity/v3/domains/afdfa4b354cb400faca779ada2819b1a => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:35.298997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb030c-a58a-4b57-b209-a116be2c5536 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:35.421892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb030c-a58a-4b57-b209-a116be2c5536 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:35.456946 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c42a6d-7f9c-4ab0-ab6c-0a9e7ef68a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:35.457606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c42a6d-7f9c-4ab0-ab6c-0a9e7ef68a23 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:35.457880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c42a6d-7f9c-4ab0-ab6c-0a9e7ef68a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:35.458147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c42a6d-7f9c-4ab0-ab6c-0a9e7ef68a23 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:35.458852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c42a6d-7f9c-4ab0-ab6c-0a9e7ef68a23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:35.460328 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c42a6d-7f9c-4ab0-ab6c-0a9e7ef68a23 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:35.483254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 589/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:17:35 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:17:37.756381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca529c-5c76-43ed-836d-f730aab34952 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:37.757220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca529c-5c76-43ed-836d-f730aab34952 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:37.757220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca529c-5c76-43ed-836d-f730aab34952 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:37.759435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 589/1178] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:37.765165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51283dfe-65d4-4862-b8cb-99774c837fdd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:37.765608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51283dfe-65d4-4862-b8cb-99774c837fdd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:37.765705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51283dfe-65d4-4862-b8cb-99774c837fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:37.784556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-51283dfe-65d4-4862-b8cb-99774c837fdd None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:37.785733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-51283dfe-65d4-4862-b8cb-99774c837fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:37.837415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:37.858538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 590/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:37.882840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca529c-5c76-43ed-836d-f730aab34952 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:37.995660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca529c-5c76-43ed-836d-f730aab34952 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:38.031909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d1b7-1e99-4ddd-97a4-df3039dd3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:38.032665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d1b7-1e99-4ddd-97a4-df3039dd3b2f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:38.032954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d1b7-1e99-4ddd-97a4-df3039dd3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:38.033228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d1b7-1e99-4ddd-97a4-df3039dd3b2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:38.044360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281d1b7-1e99-4ddd-97a4-df3039dd3b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5281d1b7-1e99-4ddd-97a4-df3039dd3b2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:17:38.051923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:17:38.053033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:17:38.054026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 590/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:17:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:17:38.059511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51283dfe-65d4-4862-b8cb-99774c837fdd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:38.175595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51283dfe-65d4-4862-b8cb-99774c837fdd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:38.214986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342dad3-3625-47ea-acae-43c9a7be10f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:38.215669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342dad3-3625-47ea-acae-43c9a7be10f8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:38.215949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342dad3-3625-47ea-acae-43c9a7be10f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:38.216249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342dad3-3625-47ea-acae-43c9a7be10f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:38.217001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342dad3-3625-47ea-acae-43c9a7be10f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:38.217307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342dad3-3625-47ea-acae-43c9a7be10f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:38.218676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342dad3-3625-47ea-acae-43c9a7be10f8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:38.226761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 591/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:17:38.236322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d1b7-1e99-4ddd-97a4-df3039dd3b2f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:38.272872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:38.347963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d1b7-1e99-4ddd-97a4-df3039dd3b2f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:38.386736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f35bcc-798d-4b79-badf-023d2968b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:38.387941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f35bcc-798d-4b79-badf-023d2968b016 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:38.388262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f35bcc-798d-4b79-badf-023d2968b016 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:38.388538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f35bcc-798d-4b79-badf-023d2968b016 None admin] PATH_INFO: `/v3/users/16a6d3e7a2c64c07b3a7174dc6f5e9f3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:38.402134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f35bcc-798d-4b79-badf-023d2968b016 None admin] RBAC: Authorizing `identity:get_user(user_id=16a6d3e7a2c64c07b3a7174dc6f5e9f3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:38.403725 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f35bcc-798d-4b79-badf-023d2968b016 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:38.405407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 591/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:38 2022] GET /identity/v3/users/16a6d3e7a2c64c07b3a7174dc6f5e9f3 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:38.412274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342dad3-3625-47ea-acae-43c9a7be10f8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:38.461252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:38.525140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342dad3-3625-47ea-acae-43c9a7be10f8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:38.561042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f290493-27f2-4009-9f76-eed7425a4a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:38.561621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f290493-27f2-4009-9f76-eed7425a4a56 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:38.561904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f290493-27f2-4009-9f76-eed7425a4a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:38.562212 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f290493-27f2-4009-9f76-eed7425a4a56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:38.633667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f290493-27f2-4009-9f76-eed7425a4a56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:38.635132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f290493-27f2-4009-9f76-eed7425a4a56 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:38.681876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:38.738417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 592/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:17:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:17:38.744630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f35bcc-798d-4b79-badf-023d2968b016 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:38.840895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:38.850885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f35bcc-798d-4b79-badf-023d2968b016 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:38.885975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e681f-63d6-4daa-a898-2fb7288dcde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:38.886905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e681f-63d6-4daa-a898-2fb7288dcde9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:38.887189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e681f-63d6-4daa-a898-2fb7288dcde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:38.887465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e681f-63d6-4daa-a898-2fb7288dcde9 None admin] PATH_INFO: `/v3/projects/0ae34ed676d4446182b47db7f1045aec` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:38.888670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e681f-63d6-4daa-a898-2fb7288dcde9 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae34ed676d4446182b47db7f1045aec)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:38.890122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e681f-63d6-4daa-a898-2fb7288dcde9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:38.891795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 592/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:17:38 2022] GET /identity/v3/projects/0ae34ed676d4446182b47db7f1045aec => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:38.898220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f290493-27f2-4009-9f76-eed7425a4a56 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:39.001412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f290493-27f2-4009-9f76-eed7425a4a56 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:39.035990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6219-b3fd-421b-bec6-a86232e3ac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:39.036649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6219-b3fd-421b-bec6-a86232e3ac42 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:39.036925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6219-b3fd-421b-bec6-a86232e3ac42 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:39.037196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6219-b3fd-421b-bec6-a86232e3ac42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:39.038011 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6219-b3fd-421b-bec6-a86232e3ac42 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=0ae34ed676d4446182b47db7f1045aec, user.id=16a6d3e7a2c64c07b3a7174dc6f5e9f3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:39.038322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6219-b3fd-421b-bec6-a86232e3ac42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:39.039748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6219-b3fd-421b-bec6-a86232e3ac42 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:39.045672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 593/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:17:38 2022] GET /identity/v3/role_assignments?user.id=16a6d3e7a2c64c07b3a7174dc6f5e9f3&scope.project.id=0ae34ed676d4446182b47db7f1045aec&role.id=9f557e97d94b4b499a6765419452e1ef => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:41.259870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bd1b4-263e-4026-a83f-9eaa76a5b563 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:41.260830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bd1b4-263e-4026-a83f-9eaa76a5b563 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:41.260830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bd1b4-263e-4026-a83f-9eaa76a5b563 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:41.263556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 593/1186] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:41.269057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb49606-c4c4-48de-b3c7-95cd1cdca722 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:41.269509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb49606-c4c4-48de-b3c7-95cd1cdca722 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:41.269601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb49606-c4c4-48de-b3c7-95cd1cdca722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:41.286796 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1fb49606-c4c4-48de-b3c7-95cd1cdca722 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:41.287966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1fb49606-c4c4-48de-b3c7-95cd1cdca722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:41.290704 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:41.364237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 594/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:17:41.386939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bd1b4-263e-4026-a83f-9eaa76a5b563 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:41.505202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bd1b4-263e-4026-a83f-9eaa76a5b563 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:41.541217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc017aa-1b21-43e3-80d7-a8cb3a0e801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:41.542287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc017aa-1b21-43e3-80d7-a8cb3a0e801d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:41.542573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc017aa-1b21-43e3-80d7-a8cb3a0e801d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:41.542845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc017aa-1b21-43e3-80d7-a8cb3a0e801d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:41.553699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc017aa-1b21-43e3-80d7-a8cb3a0e801d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-cfc017aa-1b21-43e3-80d7-a8cb3a0e801d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:17:41.561240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:17:41.562413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:41.563373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:17:41.567365 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 594/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:17:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:17:41.568489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb49606-c4c4-48de-b3c7-95cd1cdca722 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:41.667945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb49606-c4c4-48de-b3c7-95cd1cdca722 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:41.705401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711a83-ce1e-4af4-8c48-97eba593329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:41.706060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711a83-ce1e-4af4-8c48-97eba593329d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:41.706344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711a83-ce1e-4af4-8c48-97eba593329d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:41.706625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec711a83-ce1e-4af4-8c48-97eba593329d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:41.707372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec711a83-ce1e-4af4-8c48-97eba593329d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:41.707687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec711a83-ce1e-4af4-8c48-97eba593329d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:41.709078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec711a83-ce1e-4af4-8c48-97eba593329d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:41.717362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 595/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:17:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:41.723551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc017aa-1b21-43e3-80d7-a8cb3a0e801d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:41.745105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:41.839149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc017aa-1b21-43e3-80d7-a8cb3a0e801d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:41.881400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e227205-7375-40ab-beeb-80366bf67b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:41.882762 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e227205-7375-40ab-beeb-80366bf67b3b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:41.883181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e227205-7375-40ab-beeb-80366bf67b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:41.883601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e227205-7375-40ab-beeb-80366bf67b3b None admin] PATH_INFO: `/v3/users/16a6d3e7a2c64c07b3a7174dc6f5e9f3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:41.885750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e227205-7375-40ab-beeb-80366bf67b3b None admin] RBAC: Authorizing `identity:get_user(user_id=16a6d3e7a2c64c07b3a7174dc6f5e9f3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:41.888000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e227205-7375-40ab-beeb-80366bf67b3b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:41.890666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 595/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:41 2022] GET /identity/v3/users/16a6d3e7a2c64c07b3a7174dc6f5e9f3 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:41.896862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711a83-ce1e-4af4-8c48-97eba593329d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:41.900263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:42.008899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec711a83-ce1e-4af4-8c48-97eba593329d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:42.048177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a1ad3-c54d-48b8-8d86-2a328f23ac0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:42.049035 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a1ad3-c54d-48b8-8d86-2a328f23ac0b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:42.049316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a1ad3-c54d-48b8-8d86-2a328f23ac0b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:42.049589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a1ad3-c54d-48b8-8d86-2a328f23ac0b None admin] PATH_INFO: `/v3/projects/0ae34ed676d4446182b47db7f1045aec` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:42.050813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a1ad3-c54d-48b8-8d86-2a328f23ac0b None admin] RBAC: Authorizing `identity:get_project(project_id=0ae34ed676d4446182b47db7f1045aec)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:42.052298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a1ad3-c54d-48b8-8d86-2a328f23ac0b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:42.054014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 596/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:17:41 2022] GET /identity/v3/projects/0ae34ed676d4446182b47db7f1045aec => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:42.060534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e227205-7375-40ab-beeb-80366bf67b3b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:42.149204 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:42.167478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e227205-7375-40ab-beeb-80366bf67b3b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:42.203613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5e39-2fcf-4982-9366-f6c85793e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:42.204535 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5e39-2fcf-4982-9366-f6c85793e34b None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:42.204813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5e39-2fcf-4982-9366-f6c85793e34b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:42.205087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5e39-2fcf-4982-9366-f6c85793e34b None admin] PATH_INFO: `/v3/projects/0ae34ed676d4446182b47db7f1045aec/users/16a6d3e7a2c64c07b3a7174dc6f5e9f3/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:42.207279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5e39-2fcf-4982-9366-f6c85793e34b None admin] RBAC: Authorizing `identity:create_grant(project_id=0ae34ed676d4446182b47db7f1045aec, user_id=16a6d3e7a2c64c07b3a7174dc6f5e9f3, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:42.208767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5e39-2fcf-4982-9366-f6c85793e34b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:42.225092 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 596/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:17:42 2022] PUT /identity/v3/projects/0ae34ed676d4446182b47db7f1045aec/users/16a6d3e7a2c64c07b3a7174dc6f5e9f3/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:17:44.407346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c409835-6c7d-4745-880f-30b60f15d9c2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:44.407874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c409835-6c7d-4745-880f-30b60f15d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:44.407989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c409835-6c7d-4745-880f-30b60f15d9c2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:44.410013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 597/1193] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:17:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:17:44.419795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333f68c-ad7e-4107-ae37-32a9051cfc8f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:44.420216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333f68c-ad7e-4107-ae37-32a9051cfc8f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:44.420458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333f68c-ad7e-4107-ae37-32a9051cfc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:44.447960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4333f68c-ad7e-4107-ae37-32a9051cfc8f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:17:44.449594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4333f68c-ad7e-4107-ae37-32a9051cfc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:17:44.533449 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 597/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:17:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:17:44.561741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c409835-6c7d-4745-880f-30b60f15d9c2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:44.638683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:44.679218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c409835-6c7d-4745-880f-30b60f15d9c2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:44.714050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabef97-5055-4552-b58c-d7067c67e537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:44.714938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabef97-5055-4552-b58c-d7067c67e537 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:44.715257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabef97-5055-4552-b58c-d7067c67e537 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:44.715572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabef97-5055-4552-b58c-d7067c67e537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:44.725841 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabef97-5055-4552-b58c-d7067c67e537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8cabef97-5055-4552-b58c-d7067c67e537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:17:44.733674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:17:44.734731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:17:44.735733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 598/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:17:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:17:44.741625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333f68c-ad7e-4107-ae37-32a9051cfc8f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:44.826009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:44.850512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333f68c-ad7e-4107-ae37-32a9051cfc8f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:44.891874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2495efc-259a-448d-add5-f8319a4d3b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:44.892965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2495efc-259a-448d-add5-f8319a4d3b5d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:44.893403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2495efc-259a-448d-add5-f8319a4d3b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:44.893825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2495efc-259a-448d-add5-f8319a4d3b5d None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:44.895029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2495efc-259a-448d-add5-f8319a4d3b5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:44.895508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2495efc-259a-448d-add5-f8319a4d3b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:44.897754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2495efc-259a-448d-add5-f8319a4d3b5d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:44.908442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 598/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:17:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:44.914452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabef97-5055-4552-b58c-d7067c67e537 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:45.020283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabef97-5055-4552-b58c-d7067c67e537 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:45.048905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:45.054773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9409f0f-3211-48a1-aebd-b174e1ae56ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:45.055649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9409f0f-3211-48a1-aebd-b174e1ae56ed None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:45.055939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9409f0f-3211-48a1-aebd-b174e1ae56ed None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:45.056256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9409f0f-3211-48a1-aebd-b174e1ae56ed None admin] PATH_INFO: `/v3/users/16a6d3e7a2c64c07b3a7174dc6f5e9f3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:45.057540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9409f0f-3211-48a1-aebd-b174e1ae56ed None admin] RBAC: Authorizing `identity:get_user(user_id=16a6d3e7a2c64c07b3a7174dc6f5e9f3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:45.059536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9409f0f-3211-48a1-aebd-b174e1ae56ed None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:45.061181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 599/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Jun 4 18:17:44 2022] GET /identity/v3/users/16a6d3e7a2c64c07b3a7174dc6f5e9f3 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:45.067067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2495efc-259a-448d-add5-f8319a4d3b5d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:45.174879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2495efc-259a-448d-add5-f8319a4d3b5d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:45.210281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e775250-451a-4e33-8f7b-0337050cba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:45.210926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e775250-451a-4e33-8f7b-0337050cba96 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:45.211210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e775250-451a-4e33-8f7b-0337050cba96 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:45.211484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e775250-451a-4e33-8f7b-0337050cba96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:45.220465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:45.288310 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e775250-451a-4e33-8f7b-0337050cba96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:45.289782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e775250-451a-4e33-8f7b-0337050cba96 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:45.397356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 599/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:17:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:17:45.404492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9409f0f-3211-48a1-aebd-b174e1ae56ed None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:45.519777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9409f0f-3211-48a1-aebd-b174e1ae56ed None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:45.557557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45b53f-3f31-43e6-b2c8-5607543dc32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:45.558566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45b53f-3f31-43e6-b2c8-5607543dc32a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:45.558922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45b53f-3f31-43e6-b2c8-5607543dc32a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:45.559200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45b53f-3f31-43e6-b2c8-5607543dc32a None admin] PATH_INFO: `/v3/projects/0ae34ed676d4446182b47db7f1045aec` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:45.560414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45b53f-3f31-43e6-b2c8-5607543dc32a None admin] RBAC: Authorizing `identity:get_project(project_id=0ae34ed676d4446182b47db7f1045aec)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:45.561868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45b53f-3f31-43e6-b2c8-5607543dc32a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:45.563537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 600/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Jun 4 18:17:45 2022] GET /identity/v3/projects/0ae34ed676d4446182b47db7f1045aec => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:45.573401 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e775250-451a-4e33-8f7b-0337050cba96 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:17:45.620371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:45.681452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e775250-451a-4e33-8f7b-0337050cba96 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:17:45.716199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52f032-7a83-4e09-8757-3febf93d4487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:17:45.716844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f032-7a83-4e09-8757-3febf93d4487 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:17:45.717119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f032-7a83-4e09-8757-3febf93d4487 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:17:45.717387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f032-7a83-4e09-8757-3febf93d4487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:17:45.718212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52f032-7a83-4e09-8757-3febf93d4487 None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=0ae34ed676d4446182b47db7f1045aec, user.id=16a6d3e7a2c64c07b3a7174dc6f5e9f3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:17:45.718516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52f032-7a83-4e09-8757-3febf93d4487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:17:45.719955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52f032-7a83-4e09-8757-3febf93d4487 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:17:45.725828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 600/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:17:45 2022] GET /identity/v3/role_assignments?user.id=16a6d3e7a2c64c07b3a7174dc6f5e9f3&scope.project.id=0ae34ed676d4446182b47db7f1045aec&role.id=9f557e97d94b4b499a6765419452e1ef => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:17:55.552290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=67 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:17:55.723145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=49 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:46.960069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7144-b441-49ad-aace-6c777c950b09 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:46.960069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7144-b441-49ad-aace-6c777c950b09 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:46.960069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7144-b441-49ad-aace-6c777c950b09 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:46.960971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 601/1201] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:18:46.966225 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead07f6-2f01-4669-a2c0-64a2a16b01bc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:46.966696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead07f6-2f01-4669-a2c0-64a2a16b01bc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:46.966792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead07f6-2f01-4669-a2c0-64a2a16b01bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:46.989644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1ead07f6-2f01-4669-a2c0-64a2a16b01bc None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:18:46.990927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1ead07f6-2f01-4669-a2c0-64a2a16b01bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:18:47.077662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 601/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:18:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:18:47.105513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c7144-b441-49ad-aace-6c777c950b09 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:47.245514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c7144-b441-49ad-aace-6c777c950b09 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:47.289337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11209ef8-2bb0-4068-9af5-b37a206986e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:47.290477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11209ef8-2bb0-4068-9af5-b37a206986e6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:47.290862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11209ef8-2bb0-4068-9af5-b37a206986e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:47.291673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11209ef8-2bb0-4068-9af5-b37a206986e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:47.314085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11209ef8-2bb0-4068-9af5-b37a206986e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:47.317449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11209ef8-2bb0-4068-9af5-b37a206986e6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-11209ef8-2bb0-4068-9af5-b37a206986e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:18:47.339860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:47.341322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:47.343475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:18:47.343475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:18:47.343475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:18:47.343475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:18:47.343475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 602/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:18:47.347531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead07f6-2f01-4669-a2c0-64a2a16b01bc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:47.477754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead07f6-2f01-4669-a2c0-64a2a16b01bc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:47.517517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:47.523525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9d19-ceb1-4bbc-b01a-ecbcccbd0a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:47.524591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9d19-ceb1-4bbc-b01a-ecbcccbd0a78 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:47.524883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9d19-ceb1-4bbc-b01a-ecbcccbd0a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:47.525233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9d19-ceb1-4bbc-b01a-ecbcccbd0a78 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:47.526258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9d19-ceb1-4bbc-b01a-ecbcccbd0a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:47.526755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9d19-ceb1-4bbc-b01a-ecbcccbd0a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:47.528609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9d19-ceb1-4bbc-b01a-ecbcccbd0a78 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:47.551349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 602/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:18:47.552631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11209ef8-2bb0-4068-9af5-b37a206986e6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:47.618901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:47.681209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11209ef8-2bb0-4068-9af5-b37a206986e6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:47.730952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2917f-c7f7-4dcb-816a-29f04aafb451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:47.732031 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2917f-c7f7-4dcb-816a-29f04aafb451 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:47.732476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2917f-c7f7-4dcb-816a-29f04aafb451 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:47.732895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2917f-c7f7-4dcb-816a-29f04aafb451 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:47.733932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2917f-c7f7-4dcb-816a-29f04aafb451 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:47.735912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2917f-c7f7-4dcb-816a-29f04aafb451 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:47.768157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 603/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Jun 4 18:18:47 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:18:50.177892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a120c-ae3e-4504-9d85-9950abd38c9f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:50.178485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a120c-ae3e-4504-9d85-9950abd38c9f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:50.178485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a120c-ae3e-4504-9d85-9950abd38c9f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:50.179840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 603/1206] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:18:50.185838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59214-4de7-4960-8eb1-06b225fe7558 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:50.186312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59214-4de7-4960-8eb1-06b225fe7558 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:50.186418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f59214-4de7-4960-8eb1-06b225fe7558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:50.209890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-19f59214-4de7-4960-8eb1-06b225fe7558 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:18:50.211154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-19f59214-4de7-4960-8eb1-06b225fe7558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:18:50.290806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 604/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:18:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:18:50.314921 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a120c-ae3e-4504-9d85-9950abd38c9f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:50.457000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a120c-ae3e-4504-9d85-9950abd38c9f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:50.501511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dec0e-ef2b-48b1-b987-32dba5d3924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:50.502343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dec0e-ef2b-48b1-b987-32dba5d3924a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:50.502593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dec0e-ef2b-48b1-b987-32dba5d3924a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:50.502952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dec0e-ef2b-48b1-b987-32dba5d3924a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:50.516110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196dec0e-ef2b-48b1-b987-32dba5d3924a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-196dec0e-ef2b-48b1-b987-32dba5d3924a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:18:50.524198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:50.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:18:50.526323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 604/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:18:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:18:50.531822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f59214-4de7-4960-8eb1-06b225fe7558 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:50.579061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:50.653553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f59214-4de7-4960-8eb1-06b225fe7558 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:50.697160 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88a811-962d-4c79-a1f1-c04466015a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:50.697919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88a811-962d-4c79-a1f1-c04466015a37 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:50.698230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88a811-962d-4c79-a1f1-c04466015a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:50.698551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88a811-962d-4c79-a1f1-c04466015a37 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:50.700232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88a811-962d-4c79-a1f1-c04466015a37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:50.700551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88a811-962d-4c79-a1f1-c04466015a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:50.702110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88a811-962d-4c79-a1f1-c04466015a37 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:50.711788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 605/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:18:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:18:50.718081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dec0e-ef2b-48b1-b987-32dba5d3924a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:50.780329 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:50.840696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dec0e-ef2b-48b1-b987-32dba5d3924a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:50.886209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411050af-5d9f-446a-911d-5ea9417a897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:50.887587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411050af-5d9f-446a-911d-5ea9417a897d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:50.887922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411050af-5d9f-446a-911d-5ea9417a897d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:50.888257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411050af-5d9f-446a-911d-5ea9417a897d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:50.904051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411050af-5d9f-446a-911d-5ea9417a897d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:50.904305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411050af-5d9f-446a-911d-5ea9417a897d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-411050af-5d9f-446a-911d-5ea9417a897d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:18:50.928790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:50.930067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:50.931184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:18:50.931184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:18:50.931184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:18:50.931184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:18:50.935314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 605/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:18:50.936663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88a811-962d-4c79-a1f1-c04466015a37 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:51.052320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:51.055641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88a811-962d-4c79-a1f1-c04466015a37 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:51.102747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1fe9-6ee5-4240-964e-da18730d5184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:51.103452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1fe9-6ee5-4240-964e-da18730d5184 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:51.103739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1fe9-6ee5-4240-964e-da18730d5184 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:51.104034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1fe9-6ee5-4240-964e-da18730d5184 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:51.104815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a1fe9-6ee5-4240-964e-da18730d5184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:51.105150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a1fe9-6ee5-4240-964e-da18730d5184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:51.106610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a1fe9-6ee5-4240-964e-da18730d5184 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:51.119936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 606/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:18:51.126295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411050af-5d9f-446a-911d-5ea9417a897d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:51.250227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411050af-5d9f-446a-911d-5ea9417a897d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:51.252772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:51.294212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d5b46-a2a4-4a78-af9c-dd04fdda46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:51.295391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5b46-a2a4-4a78-af9c-dd04fdda46c0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:51.295862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5b46-a2a4-4a78-af9c-dd04fdda46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:51.296345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5b46-a2a4-4a78-af9c-dd04fdda46c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:51.304680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d5b46-a2a4-4a78-af9c-dd04fdda46c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:51.306115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d5b46-a2a4-4a78-af9c-dd04fdda46c0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b85d5b46-a2a4-4a78-af9c-dd04fdda46c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:18:51.322683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:51.326741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:18:51.327920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 606/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:18:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:18:51.330321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1fe9-6ee5-4240-964e-da18730d5184 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:51.461666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1fe9-6ee5-4240-964e-da18730d5184 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:51.500173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464dae9-f0df-4cb1-adc3-fd00d8117b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:51.500990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464dae9-f0df-4cb1-adc3-fd00d8117b54 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:51.501263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464dae9-f0df-4cb1-adc3-fd00d8117b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:51.501589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464dae9-f0df-4cb1-adc3-fd00d8117b54 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:51.502525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464dae9-f0df-4cb1-adc3-fd00d8117b54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:51.502862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464dae9-f0df-4cb1-adc3-fd00d8117b54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:51.504362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464dae9-f0df-4cb1-adc3-fd00d8117b54 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:51.524812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 607/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 4 18:18:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:18:51.531199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d5b46-a2a4-4a78-af9c-dd04fdda46c0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:51.647293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d5b46-a2a4-4a78-af9c-dd04fdda46c0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:51.687504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae72dd-d157-4812-8c2e-181a548d9549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:51.688215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae72dd-d157-4812-8c2e-181a548d9549 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:51.688693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae72dd-d157-4812-8c2e-181a548d9549 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:51.688989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae72dd-d157-4812-8c2e-181a548d9549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:51.723989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:51.776557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae72dd-d157-4812-8c2e-181a548d9549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:51.778812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae72dd-d157-4812-8c2e-181a548d9549 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:51.909369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 607/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:18:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:18:51.910786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464dae9-f0df-4cb1-adc3-fd00d8117b54 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:51.934879 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:52.028919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464dae9-f0df-4cb1-adc3-fd00d8117b54 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:52.070484 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e48fd4-1279-4a61-b12b-ddfdffc447c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:52.071615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e48fd4-1279-4a61-b12b-ddfdffc447c8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:52.071960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e48fd4-1279-4a61-b12b-ddfdffc447c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:52.072334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e48fd4-1279-4a61-b12b-ddfdffc447c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:52.085789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e48fd4-1279-4a61-b12b-ddfdffc447c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:52.087711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e48fd4-1279-4a61-b12b-ddfdffc447c8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-05e48fd4-1279-4a61-b12b-ddfdffc447c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:18:52.110069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:52.111205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:52.112198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:18:52.112198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:18:52.112198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:18:52.112198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:18:52.112198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 608/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:18:52.117439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae72dd-d157-4812-8c2e-181a548d9549 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:52.190172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:52.237541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae72dd-d157-4812-8c2e-181a548d9549 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:52.281528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53c16-c2f1-4a46-840d-6e3562aa7824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:52.282227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53c16-c2f1-4a46-840d-6e3562aa7824 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:52.282540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53c16-c2f1-4a46-840d-6e3562aa7824 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:52.282765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a53c16-c2f1-4a46-840d-6e3562aa7824 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:52.283508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a53c16-c2f1-4a46-840d-6e3562aa7824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:52.283821 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a53c16-c2f1-4a46-840d-6e3562aa7824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:52.285275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a53c16-c2f1-4a46-840d-6e3562aa7824 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:52.298635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 608/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:18:52.305256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e48fd4-1279-4a61-b12b-ddfdffc447c8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:52.387238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:52.425287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e48fd4-1279-4a61-b12b-ddfdffc447c8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:52.461126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cb28-3bce-4038-b1c5-9b6ff210901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:52.461906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cb28-3bce-4038-b1c5-9b6ff210901a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:52.462203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cb28-3bce-4038-b1c5-9b6ff210901a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:52.462483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cb28-3bce-4038-b1c5-9b6ff210901a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:52.469516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475cb28-3bce-4038-b1c5-9b6ff210901a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:52.470983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475cb28-3bce-4038-b1c5-9b6ff210901a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f475cb28-3bce-4038-b1c5-9b6ff210901a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:18:52.485527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:52.486590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:52.492581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:18:52.492581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:18:52.492581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:18:52.492581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:18:52.492581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:18:52.492581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:18:52.492581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:18:52.492581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:18:52.492581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 609/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:18:52.495088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53c16-c2f1-4a46-840d-6e3562aa7824 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:52.600807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a53c16-c2f1-4a46-840d-6e3562aa7824 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:52.624282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:52.636485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad138aa-a91f-49a2-bd01-2fc38713d217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:52.637351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad138aa-a91f-49a2-bd01-2fc38713d217 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:52.637468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad138aa-a91f-49a2-bd01-2fc38713d217 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:52.637709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad138aa-a91f-49a2-bd01-2fc38713d217 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:52.638503 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad138aa-a91f-49a2-bd01-2fc38713d217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:52.638827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad138aa-a91f-49a2-bd01-2fc38713d217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:52.640306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad138aa-a91f-49a2-bd01-2fc38713d217 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:52.653032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 609/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:18:52.660205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cb28-3bce-4038-b1c5-9b6ff210901a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:52.769365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cb28-3bce-4038-b1c5-9b6ff210901a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:52.799453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:52.805862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd163f-2c0c-4a53-be57-254e1f2104ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:52.806463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd163f-2c0c-4a53-be57-254e1f2104ac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:52.807038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd163f-2c0c-4a53-be57-254e1f2104ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:52.807484 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd163f-2c0c-4a53-be57-254e1f2104ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:52.808536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd163f-2c0c-4a53-be57-254e1f2104ac None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=9edcf71253ee4c81a402fffe13128b97) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:52.808979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd163f-2c0c-4a53-be57-254e1f2104ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:52.810164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd163f-2c0c-4a53-be57-254e1f2104ac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:52.815737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 610/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:18:52 2022] GET /identity/v3/role_assignments?user.id=9edcf71253ee4c81a402fffe13128b97&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:18:55.043648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9c5ff-4f1c-4f2e-acf3-3e4230f82976 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:55.044277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9c5ff-4f1c-4f2e-acf3-3e4230f82976 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:55.044277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9c5ff-4f1c-4f2e-acf3-3e4230f82976 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:55.045608 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 610/1220] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:18:55.050984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384487b-4d1c-44f4-b6a5-872fe3bb0954 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:55.051454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384487b-4d1c-44f4-b6a5-872fe3bb0954 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:55.051554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384487b-4d1c-44f4-b6a5-872fe3bb0954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:55.069944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c384487b-4d1c-44f4-b6a5-872fe3bb0954 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:18:55.071149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c384487b-4d1c-44f4-b6a5-872fe3bb0954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:18:55.158680 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 611/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:18:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:18:55.184058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9c5ff-4f1c-4f2e-acf3-3e4230f82976 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:55.299005 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9c5ff-4f1c-4f2e-acf3-3e4230f82976 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:55.337116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e6d3-41f6-4088-b7cb-e34f57762268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:55.338075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e6d3-41f6-4088-b7cb-e34f57762268 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:55.338356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e6d3-41f6-4088-b7cb-e34f57762268 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:55.338632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4e6d3-41f6-4088-b7cb-e34f57762268 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:55.351412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4e6d3-41f6-4088-b7cb-e34f57762268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c7f4e6d3-41f6-4088-b7cb-e34f57762268 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:18:55.359539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:55.360798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:18:55.361902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 611/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:18:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:18:55.369652 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384487b-4d1c-44f4-b6a5-872fe3bb0954 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:55.484205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384487b-4d1c-44f4-b6a5-872fe3bb0954 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:55.508288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:55.520782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787e01-5e2d-4c0e-b5c1-e0eb1b0ef0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:55.521581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787e01-5e2d-4c0e-b5c1-e0eb1b0ef0ce None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:55.521863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787e01-5e2d-4c0e-b5c1-e0eb1b0ef0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:55.522142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787e01-5e2d-4c0e-b5c1-e0eb1b0ef0ce None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:55.523046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71787e01-5e2d-4c0e-b5c1-e0eb1b0ef0ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:55.523378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71787e01-5e2d-4c0e-b5c1-e0eb1b0ef0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:55.524917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71787e01-5e2d-4c0e-b5c1-e0eb1b0ef0ce None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:55.534349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 612/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:18:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:18:55.541543 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e6d3-41f6-4088-b7cb-e34f57762268 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:55.592708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:55.650689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4e6d3-41f6-4088-b7cb-e34f57762268 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:55.687758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8b9b5-cd57-4c8d-a2d7-d4f0786168b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:55.688599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b9b5-cd57-4c8d-a2d7-d4f0786168b6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:55.688883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b9b5-cd57-4c8d-a2d7-d4f0786168b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:55.689162 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b9b5-cd57-4c8d-a2d7-d4f0786168b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:55.700770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8b9b5-cd57-4c8d-a2d7-d4f0786168b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:55.702427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8b9b5-cd57-4c8d-a2d7-d4f0786168b6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a8e8b9b5-cd57-4c8d-a2d7-d4f0786168b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:18:55.721247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:55.722300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:55.728259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:18:55.728259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:18:55.728259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:18:55.728259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:18:55.728259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 612/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:18:55.729297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787e01-5e2d-4c0e-b5c1-e0eb1b0ef0ce None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:55.839193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787e01-5e2d-4c0e-b5c1-e0eb1b0ef0ce None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:55.879122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c72d9d-c1f9-4c30-a542-8cecc11b53da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:55.879816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c72d9d-c1f9-4c30-a542-8cecc11b53da None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:55.880253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c72d9d-c1f9-4c30-a542-8cecc11b53da None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:55.880533 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c72d9d-c1f9-4c30-a542-8cecc11b53da None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:55.881258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c72d9d-c1f9-4c30-a542-8cecc11b53da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:55.881563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c72d9d-c1f9-4c30-a542-8cecc11b53da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:55.882940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c72d9d-c1f9-4c30-a542-8cecc11b53da None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:55.895711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 613/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:18:55.901626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8b9b5-cd57-4c8d-a2d7-d4f0786168b6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:56.008635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:56.017074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8b9b5-cd57-4c8d-a2d7-d4f0786168b6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:56.058998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2337d7f-aded-4618-9c4d-9fd6f30cb481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:56.059822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2337d7f-aded-4618-9c4d-9fd6f30cb481 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:56.060137 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2337d7f-aded-4618-9c4d-9fd6f30cb481 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:56.060410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2337d7f-aded-4618-9c4d-9fd6f30cb481 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:56.070860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2337d7f-aded-4618-9c4d-9fd6f30cb481 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:56.073287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2337d7f-aded-4618-9c4d-9fd6f30cb481 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d2337d7f-aded-4618-9c4d-9fd6f30cb481 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:18:56.095304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:56.096492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:18:56.097447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 613/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:18:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:18:56.103570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c72d9d-c1f9-4c30-a542-8cecc11b53da None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:56.159083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:56.218469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c72d9d-c1f9-4c30-a542-8cecc11b53da None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:56.257723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf03a70-dff1-4ef2-83d8-b614c90f1f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:56.258491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf03a70-dff1-4ef2-83d8-b614c90f1f9d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:56.258805 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf03a70-dff1-4ef2-83d8-b614c90f1f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:56.259170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf03a70-dff1-4ef2-83d8-b614c90f1f9d None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:56.260201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf03a70-dff1-4ef2-83d8-b614c90f1f9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:56.260695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf03a70-dff1-4ef2-83d8-b614c90f1f9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:56.262610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf03a70-dff1-4ef2-83d8-b614c90f1f9d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:56.283038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 614/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 4 18:18:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:18:56.290484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2337d7f-aded-4618-9c4d-9fd6f30cb481 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:56.401546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2337d7f-aded-4618-9c4d-9fd6f30cb481 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:56.441440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fac5ec-c005-45ec-9de5-301ed5da667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:56.442420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fac5ec-c005-45ec-9de5-301ed5da667f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:56.442728 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fac5ec-c005-45ec-9de5-301ed5da667f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:56.442968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fac5ec-c005-45ec-9de5-301ed5da667f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:56.456908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fac5ec-c005-45ec-9de5-301ed5da667f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:56.458559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fac5ec-c005-45ec-9de5-301ed5da667f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-81fac5ec-c005-45ec-9de5-301ed5da667f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:18:56.477929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:56.479093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:56.480522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:18:56.480522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:18:56.480522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:18:56.480522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:18:56.480522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 614/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:18:56.486436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf03a70-dff1-4ef2-83d8-b614c90f1f9d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:56.594387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf03a70-dff1-4ef2-83d8-b614c90f1f9d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:56.596729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:56.629766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a044d9-ac4b-4df3-8386-08a50dd55d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:56.630447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a044d9-ac4b-4df3-8386-08a50dd55d6d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:56.630741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a044d9-ac4b-4df3-8386-08a50dd55d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:56.631019 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a044d9-ac4b-4df3-8386-08a50dd55d6d None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:56.631759 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a044d9-ac4b-4df3-8386-08a50dd55d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:56.632102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a044d9-ac4b-4df3-8386-08a50dd55d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:56.633500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a044d9-ac4b-4df3-8386-08a50dd55d6d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:56.645611 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 615/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:18:56.651672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fac5ec-c005-45ec-9de5-301ed5da667f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:56.663299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:56.761823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fac5ec-c005-45ec-9de5-301ed5da667f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:56.801354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3a08c-5e2e-4280-a314-74b068941c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:56.802261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3a08c-5e2e-4280-a314-74b068941c15 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:56.802544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3a08c-5e2e-4280-a314-74b068941c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:56.802815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3a08c-5e2e-4280-a314-74b068941c15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:56.810346 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3a08c-5e2e-4280-a314-74b068941c15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:56.811835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3a08c-5e2e-4280-a314-74b068941c15 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3ba3a08c-5e2e-4280-a314-74b068941c15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:18:56.827873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:56.829407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:56.830408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:18:56.830408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:18:56.830408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:18:56.830408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:18:56.830408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:18:56.830408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:18:56.830408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:18:56.830408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:18:56.830408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 615/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:18:56.835540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a044d9-ac4b-4df3-8386-08a50dd55d6d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:56.945414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a044d9-ac4b-4df3-8386-08a50dd55d6d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:56.980326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc8297-e7b2-47bb-8cf2-2d8bda7e066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:56.981012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc8297-e7b2-47bb-8cf2-2d8bda7e066b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:56.981298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc8297-e7b2-47bb-8cf2-2d8bda7e066b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:56.981564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc8297-e7b2-47bb-8cf2-2d8bda7e066b None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:56.982374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc8297-e7b2-47bb-8cf2-2d8bda7e066b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:18:56.982681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc8297-e7b2-47bb-8cf2-2d8bda7e066b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:56.984149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc8297-e7b2-47bb-8cf2-2d8bda7e066b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:56.996536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 616/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:18:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:18:57.002619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3a08c-5e2e-4280-a314-74b068941c15 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:57.075592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:57.112485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3a08c-5e2e-4280-a314-74b068941c15 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:57.146141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc405d7-cfa9-4cd9-84c3-17b39ca58e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:57.147057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc405d7-cfa9-4cd9-84c3-17b39ca58e78 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:57.147329 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc405d7-cfa9-4cd9-84c3-17b39ca58e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:57.147605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc405d7-cfa9-4cd9-84c3-17b39ca58e78 None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/9edcf71253ee4c81a402fffe13128b97/roles/85ff050dde264c0fbb4e9e7efa4c1a34` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:57.162633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc405d7-cfa9-4cd9-84c3-17b39ca58e78 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=9edcf71253ee4c81a402fffe13128b97, role_id=85ff050dde264c0fbb4e9e7efa4c1a34)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:18:57.164546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc405d7-cfa9-4cd9-84c3-17b39ca58e78 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:18:57.181620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 616/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:18:57 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/9edcf71253ee4c81a402fffe13128b97/roles/85ff050dde264c0fbb4e9e7efa4c1a34 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:18:59.542539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5df84-e0f0-4583-821e-cf713079c4f1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:59.543173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5df84-e0f0-4583-821e-cf713079c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:59.543173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5df84-e0f0-4583-821e-cf713079c4f1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:59.544937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 617/1233] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:18:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:18:59.551612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b8a0-88f1-4140-bed0-6d4a57b9945b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:59.552156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b8a0-88f1-4140-bed0-6d4a57b9945b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:59.552244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b8a0-88f1-4140-bed0-6d4a57b9945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:59.569686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-72e4b8a0-88f1-4140-bed0-6d4a57b9945b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:18:59.570831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-72e4b8a0-88f1-4140-bed0-6d4a57b9945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:18:59.653286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 617/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:18:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:18:59.680066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5df84-e0f0-4583-821e-cf713079c4f1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:59.707783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:59.794161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5df84-e0f0-4583-821e-cf713079c4f1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:18:59.834609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a75acf-513c-459a-a0c5-403df0637815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:18:59.835327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a75acf-513c-459a-a0c5-403df0637815 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:18:59.835641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a75acf-513c-459a-a0c5-403df0637815 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:18:59.835915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a75acf-513c-459a-a0c5-403df0637815 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:18:59.846471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a75acf-513c-459a-a0c5-403df0637815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c8a75acf-513c-459a-a0c5-403df0637815 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:18:59.854103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:18:59.855239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:18:59.856170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 618/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Jun 4 18:18:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:18:59.862182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b8a0-88f1-4140-bed0-6d4a57b9945b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:18:59.911690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:18:59.967744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b8a0-88f1-4140-bed0-6d4a57b9945b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:00.001596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb99c9-b3fe-40b1-99b1-7c117d1a7996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:00.002280 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb99c9-b3fe-40b1-99b1-7c117d1a7996 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:00.002570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb99c9-b3fe-40b1-99b1-7c117d1a7996 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:00.002844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb99c9-b3fe-40b1-99b1-7c117d1a7996 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:00.003604 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb99c9-b3fe-40b1-99b1-7c117d1a7996 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:00.003916 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb99c9-b3fe-40b1-99b1-7c117d1a7996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:00.005343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb99c9-b3fe-40b1-99b1-7c117d1a7996 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:00.014428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 618/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Jun 4 18:18:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:00.020269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a75acf-513c-459a-a0c5-403df0637815 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:00.125025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:00.143698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a75acf-513c-459a-a0c5-403df0637815 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:00.180583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb024d-a17a-47cb-bc30-a40e9813be8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:00.181403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb024d-a17a-47cb-bc30-a40e9813be8a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:00.181688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb024d-a17a-47cb-bc30-a40e9813be8a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:00.181966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb024d-a17a-47cb-bc30-a40e9813be8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:00.194143 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb024d-a17a-47cb-bc30-a40e9813be8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:00.195625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb024d-a17a-47cb-bc30-a40e9813be8a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-fccb024d-a17a-47cb-bc30-a40e9813be8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:19:00.213237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:00.214503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:00.215413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:19:00.215413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:19:00.215413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:00.215413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:00.215788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 619/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:00.220405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb99c9-b3fe-40b1-99b1-7c117d1a7996 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:00.327296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb99c9-b3fe-40b1-99b1-7c117d1a7996 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:00.338076 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:00.364058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ddd03-9593-4563-bfff-73053bd67f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:00.364777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ddd03-9593-4563-bfff-73053bd67f4a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:00.365066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ddd03-9593-4563-bfff-73053bd67f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:00.365343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ddd03-9593-4563-bfff-73053bd67f4a None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:00.372471 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ddd03-9593-4563-bfff-73053bd67f4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:00.372793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ddd03-9593-4563-bfff-73053bd67f4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:00.374226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ddd03-9593-4563-bfff-73053bd67f4a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:00.386636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 619/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:19:00.392691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb024d-a17a-47cb-bc30-a40e9813be8a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:00.508584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb024d-a17a-47cb-bc30-a40e9813be8a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:00.543535 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5f09d-eb64-4cf8-856d-05a745cd25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:00.544439 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5f09d-eb64-4cf8-856d-05a745cd25ff None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:00.544724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5f09d-eb64-4cf8-856d-05a745cd25ff None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:00.544998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5f09d-eb64-4cf8-856d-05a745cd25ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:00.547899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:00.553098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5f09d-eb64-4cf8-856d-05a745cd25ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:00.554748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5f09d-eb64-4cf8-856d-05a745cd25ff None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-67b5f09d-eb64-4cf8-856d-05a745cd25ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:19:00.570081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:00.571380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:00.572511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 620/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:19:00.577395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ddd03-9593-4563-bfff-73053bd67f4a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:00.683784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ddd03-9593-4563-bfff-73053bd67f4a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:00.720316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08860938-8cde-484c-a3c6-ad3f4605a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:00.721027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08860938-8cde-484c-a3c6-ad3f4605a463 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:00.721306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08860938-8cde-484c-a3c6-ad3f4605a463 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:00.721582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08860938-8cde-484c-a3c6-ad3f4605a463 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:00.722450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08860938-8cde-484c-a3c6-ad3f4605a463 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:00.722752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08860938-8cde-484c-a3c6-ad3f4605a463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:00.724244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08860938-8cde-484c-a3c6-ad3f4605a463 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:00.746986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 620/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 4 18:19:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:00.753290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5f09d-eb64-4cf8-856d-05a745cd25ff None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:00.858040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5f09d-eb64-4cf8-856d-05a745cd25ff None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:00.898770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac20e9-30cf-4d3f-a14f-25b9bb71c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:00.899998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac20e9-30cf-4d3f-a14f-25b9bb71c452 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:00.900523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac20e9-30cf-4d3f-a14f-25b9bb71c452 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:00.900893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac20e9-30cf-4d3f-a14f-25b9bb71c452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:00.971614 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:00.979403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac20e9-30cf-4d3f-a14f-25b9bb71c452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:00.981069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac20e9-30cf-4d3f-a14f-25b9bb71c452 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:01.100057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 621/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:19:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:19:01.102394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08860938-8cde-484c-a3c6-ad3f4605a463 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:01.135188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:01.214997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08860938-8cde-484c-a3c6-ad3f4605a463 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:01.250170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e213b54-8e16-4e0f-8800-c7b56bb93475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:01.250941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213b54-8e16-4e0f-8800-c7b56bb93475 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:01.251221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213b54-8e16-4e0f-8800-c7b56bb93475 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:01.251495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213b54-8e16-4e0f-8800-c7b56bb93475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:01.263012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e213b54-8e16-4e0f-8800-c7b56bb93475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:01.264763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e213b54-8e16-4e0f-8800-c7b56bb93475 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6e213b54-8e16-4e0f-8800-c7b56bb93475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:19:01.284267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:01.285389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:01.291279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:19:01.291279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:19:01.291279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:01.291279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:01.291279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 621/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:19:01.291641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac20e9-30cf-4d3f-a14f-25b9bb71c452 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:01.395946 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:01.402375 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac20e9-30cf-4d3f-a14f-25b9bb71c452 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:01.442175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c0f7a-6994-41a5-a3f9-622d8e87b70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:01.442851 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c0f7a-6994-41a5-a3f9-622d8e87b70c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:01.443145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c0f7a-6994-41a5-a3f9-622d8e87b70c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:01.443486 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c0f7a-6994-41a5-a3f9-622d8e87b70c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:01.444262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c0f7a-6994-41a5-a3f9-622d8e87b70c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:01.444597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c0f7a-6994-41a5-a3f9-622d8e87b70c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:01.445981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c0f7a-6994-41a5-a3f9-622d8e87b70c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:01.457621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 622/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:01.463560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e213b54-8e16-4e0f-8800-c7b56bb93475 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:01.550960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:01.574820 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e213b54-8e16-4e0f-8800-c7b56bb93475 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:01.612651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb20b43-8294-45f9-b402-87a3938177bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:01.613495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20b43-8294-45f9-b402-87a3938177bb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:01.613779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20b43-8294-45f9-b402-87a3938177bb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:01.614062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20b43-8294-45f9-b402-87a3938177bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:01.621770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb20b43-8294-45f9-b402-87a3938177bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:01.623253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb20b43-8294-45f9-b402-87a3938177bb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-acb20b43-8294-45f9-b402-87a3938177bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:19:01.638327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:01.639504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:01.640511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:19:01.640511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:19:01.640511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:19:01.640511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:19:01.640511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:19:01.640511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:19:01.640511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:19:01.640511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:01.640511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 622/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:01.645425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c0f7a-6994-41a5-a3f9-622d8e87b70c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:01.769020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c0f7a-6994-41a5-a3f9-622d8e87b70c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:01.804915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0454419-5d83-49e6-ab92-c2f62c3632fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:01.805516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0454419-5d83-49e6-ab92-c2f62c3632fc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:01.805795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0454419-5d83-49e6-ab92-c2f62c3632fc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:01.806065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0454419-5d83-49e6-ab92-c2f62c3632fc None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:01.806850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0454419-5d83-49e6-ab92-c2f62c3632fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:01.807161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0454419-5d83-49e6-ab92-c2f62c3632fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:01.809180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0454419-5d83-49e6-ab92-c2f62c3632fc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:01.828863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 623/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:19:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:01.830359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb20b43-8294-45f9-b402-87a3938177bb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:01.946648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb20b43-8294-45f9-b402-87a3938177bb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:01.983314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed1e60-bbf5-485c-8005-581208a23795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:01.983987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed1e60-bbf5-485c-8005-581208a23795 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:01.984311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed1e60-bbf5-485c-8005-581208a23795 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:01.984593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed1e60-bbf5-485c-8005-581208a23795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:01.985439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed1e60-bbf5-485c-8005-581208a23795 None admin] RBAC: Adding query filter params (role.id=85ff050dde264c0fbb4e9e7efa4c1a34, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=9edcf71253ee4c81a402fffe13128b97) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:01.985757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed1e60-bbf5-485c-8005-581208a23795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:01.987242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed1e60-bbf5-485c-8005-581208a23795 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:01.994493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 623/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:19:01 2022] GET /identity/v3/role_assignments?user.id=9edcf71253ee4c81a402fffe13128b97&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=85ff050dde264c0fbb4e9e7efa4c1a34 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:04.378589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7a211-25ce-4d3c-97a8-87c71343970f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:04.379164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7a211-25ce-4d3c-97a8-87c71343970f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:04.379164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7a211-25ce-4d3c-97a8-87c71343970f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:04.380632 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 624/1247] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:19:04.385938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51df3e-d2db-4426-a02c-8ba16e131f1d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:04.386370 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51df3e-d2db-4426-a02c-8ba16e131f1d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:04.386477 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51df3e-d2db-4426-a02c-8ba16e131f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:04.392602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:04.407011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4a51df3e-d2db-4426-a02c-8ba16e131f1d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:19:04.408258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4a51df3e-d2db-4426-a02c-8ba16e131f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:19:04.493908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 624/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:19:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:19:04.518891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7a211-25ce-4d3c-97a8-87c71343970f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:04.541468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:04.646967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7a211-25ce-4d3c-97a8-87c71343970f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:04.685738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1626561-d022-4db7-a433-9558d70d3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:04.686555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1626561-d022-4db7-a433-9558d70d3a03 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:04.686859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1626561-d022-4db7-a433-9558d70d3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:04.687110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1626561-d022-4db7-a433-9558d70d3a03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:04.699061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1626561-d022-4db7-a433-9558d70d3a03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c1626561-d022-4db7-a433-9558d70d3a03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:19:04.707393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:04.708392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:04.709241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 625/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:04.715384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51df3e-d2db-4426-a02c-8ba16e131f1d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:04.829956 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51df3e-d2db-4426-a02c-8ba16e131f1d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:04.861992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:04.868895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8692d09-3382-4c2a-bd09-d55f1644f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:04.869631 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692d09-3382-4c2a-bd09-d55f1644f820 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:04.869951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692d09-3382-4c2a-bd09-d55f1644f820 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:04.870259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692d09-3382-4c2a-bd09-d55f1644f820 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:04.871108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8692d09-3382-4c2a-bd09-d55f1644f820 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:04.871381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8692d09-3382-4c2a-bd09-d55f1644f820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:04.872877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8692d09-3382-4c2a-bd09-d55f1644f820 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:04.882446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 625/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:19:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:04.889442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1626561-d022-4db7-a433-9558d70d3a03 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:04.973871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:05.000219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1626561-d022-4db7-a433-9558d70d3a03 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:05.037254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79a317-17e8-4100-8b9f-772cdae6ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:05.038303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79a317-17e8-4100-8b9f-772cdae6ff9c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:05.038844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79a317-17e8-4100-8b9f-772cdae6ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:05.039127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79a317-17e8-4100-8b9f-772cdae6ff9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:05.054234 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79a317-17e8-4100-8b9f-772cdae6ff9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:05.055768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79a317-17e8-4100-8b9f-772cdae6ff9c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1f79a317-17e8-4100-8b9f-772cdae6ff9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:19:05.075392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:05.076359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:05.077319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:19:05.077319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:19:05.077319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:05.077319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:05.077319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 626/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:05.083082 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8692d09-3382-4c2a-bd09-d55f1644f820 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:05.201096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8692d09-3382-4c2a-bd09-d55f1644f820 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:05.243616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffd629-9ee1-447d-8b45-9cd98d5748e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:05.244284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffd629-9ee1-447d-8b45-9cd98d5748e4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:05.244562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffd629-9ee1-447d-8b45-9cd98d5748e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:05.244830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffd629-9ee1-447d-8b45-9cd98d5748e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:05.245582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffd629-9ee1-447d-8b45-9cd98d5748e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:05.245881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffd629-9ee1-447d-8b45-9cd98d5748e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:05.247883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffd629-9ee1-447d-8b45-9cd98d5748e4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:05.265813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 626/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:19:05.271750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79a317-17e8-4100-8b9f-772cdae6ff9c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:05.396051 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79a317-17e8-4100-8b9f-772cdae6ff9c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:05.427164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:05.437406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb9dc3-8bd8-444c-867b-a42e1658410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:05.438219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9dc3-8bd8-444c-867b-a42e1658410f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:05.438506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9dc3-8bd8-444c-867b-a42e1658410f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:05.438782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb9dc3-8bd8-444c-867b-a42e1658410f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:05.448131 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb9dc3-8bd8-444c-867b-a42e1658410f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:05.450270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb9dc3-8bd8-444c-867b-a42e1658410f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b8cb9dc3-8bd8-444c-867b-a42e1658410f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:19:05.467671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:05.469059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:05.470378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 627/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:05.475159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffd629-9ee1-447d-8b45-9cd98d5748e4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:05.539210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:05.591010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffd629-9ee1-447d-8b45-9cd98d5748e4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:05.631974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedeb961-ea0e-44f9-9a84-b06b4c347420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:05.632797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb961-ea0e-44f9-9a84-b06b4c347420 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:05.633140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb961-ea0e-44f9-9a84-b06b4c347420 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:05.633479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb961-ea0e-44f9-9a84-b06b4c347420 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:05.634510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedeb961-ea0e-44f9-9a84-b06b4c347420 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:05.634861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedeb961-ea0e-44f9-9a84-b06b4c347420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:05.637314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedeb961-ea0e-44f9-9a84-b06b4c347420 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:05.656941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 627/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 4 18:19:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:05.662982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb9dc3-8bd8-444c-867b-a42e1658410f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:05.777688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb9dc3-8bd8-444c-867b-a42e1658410f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:05.814455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fcf5f-285a-4315-942c-cf3383ef04fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:05.815033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fcf5f-285a-4315-942c-cf3383ef04fe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:05.815313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fcf5f-285a-4315-942c-cf3383ef04fe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:05.815673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fcf5f-285a-4315-942c-cf3383ef04fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:05.879665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:05.893747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fcf5f-285a-4315-942c-cf3383ef04fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:05.895446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fcf5f-285a-4315-942c-cf3383ef04fe None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:06.006528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 628/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:19:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 18:19:06.013583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedeb961-ea0e-44f9-9a84-b06b4c347420 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:06.137788 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedeb961-ea0e-44f9-9a84-b06b4c347420 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:06.152881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:06.177609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a722ed4-618e-40c8-9d3c-350b6b7bd6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:06.178443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a722ed4-618e-40c8-9d3c-350b6b7bd6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:06.178722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a722ed4-618e-40c8-9d3c-350b6b7bd6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:06.178998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a722ed4-618e-40c8-9d3c-350b6b7bd6f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:06.189854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a722ed4-618e-40c8-9d3c-350b6b7bd6f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:06.191521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a722ed4-618e-40c8-9d3c-350b6b7bd6f8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7a722ed4-618e-40c8-9d3c-350b6b7bd6f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:19:06.209959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:06.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:06.211965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:19:06.211965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:19:06.211965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:06.211965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:06.211965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 628/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:06.217551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fcf5f-285a-4315-942c-cf3383ef04fe None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:06.319059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:06.333629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fcf5f-285a-4315-942c-cf3383ef04fe None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:06.373514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433805d-9ee6-4b1a-8d74-8d1c22033039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:06.374438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433805d-9ee6-4b1a-8d74-8d1c22033039 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:06.374722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433805d-9ee6-4b1a-8d74-8d1c22033039 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:06.375025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433805d-9ee6-4b1a-8d74-8d1c22033039 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:06.375914 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433805d-9ee6-4b1a-8d74-8d1c22033039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:06.376386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433805d-9ee6-4b1a-8d74-8d1c22033039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:06.378103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433805d-9ee6-4b1a-8d74-8d1c22033039 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:06.392697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 629/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:06.398663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a722ed4-618e-40c8-9d3c-350b6b7bd6f8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:06.525565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a722ed4-618e-40c8-9d3c-350b6b7bd6f8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:06.708324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2494631-cecf-4db1-b9a3-28deccd07af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:06.709117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2494631-cecf-4db1-b9a3-28deccd07af6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:06.709395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2494631-cecf-4db1-b9a3-28deccd07af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:06.709662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2494631-cecf-4db1-b9a3-28deccd07af6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:06.717387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2494631-cecf-4db1-b9a3-28deccd07af6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:06.719098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2494631-cecf-4db1-b9a3-28deccd07af6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f2494631-cecf-4db1-b9a3-28deccd07af6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:19:06.735246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:06.736411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:06.742311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:19:06.742311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:19:06.742311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:19:06.742311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:19:06.742311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:19:06.742311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:19:06.742311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:19:06.742311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:06.742311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 629/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:06.743422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433805d-9ee6-4b1a-8d74-8d1c22033039 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:06.853513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433805d-9ee6-4b1a-8d74-8d1c22033039 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:06.889892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d3239-aa2b-4c18-b63e-baec70ef0dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:06.890591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3239-aa2b-4c18-b63e-baec70ef0dbd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:06.890872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3239-aa2b-4c18-b63e-baec70ef0dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:06.891149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d3239-aa2b-4c18-b63e-baec70ef0dbd None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:06.891933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d3239-aa2b-4c18-b63e-baec70ef0dbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:06.892270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d3239-aa2b-4c18-b63e-baec70ef0dbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:06.893705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d3239-aa2b-4c18-b63e-baec70ef0dbd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:06.906798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 630/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:06.913288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2494631-cecf-4db1-b9a3-28deccd07af6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:06.939961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:07.018214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2494631-cecf-4db1-b9a3-28deccd07af6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:07.056856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a72a31-87fb-4871-81b9-66222501756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:07.057569 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a72a31-87fb-4871-81b9-66222501756d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:07.058017 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a72a31-87fb-4871-81b9-66222501756d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:07.058325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a72a31-87fb-4871-81b9-66222501756d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:07.059297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a72a31-87fb-4871-81b9-66222501756d None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=9edcf71253ee4c81a402fffe13128b97) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:07.059609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a72a31-87fb-4871-81b9-66222501756d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:07.061167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a72a31-87fb-4871-81b9-66222501756d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:07.067741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 630/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:19:06 2022] GET /identity/v3/role_assignments?user.id=9edcf71253ee4c81a402fffe13128b97&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=9f557e97d94b4b499a6765419452e1ef => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:09.324187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321eb18-8c07-4bea-8575-fc4f1ad785a1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:09.324636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321eb18-8c07-4bea-8575-fc4f1ad785a1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:09.324765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321eb18-8c07-4bea-8575-fc4f1ad785a1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:09.326107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 631/1261] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:19:09.332482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0dc7c-c2e6-4ec8-a68f-6c661e33be48 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:09.332892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0dc7c-c2e6-4ec8-a68f-6c661e33be48 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:09.333116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0dc7c-c2e6-4ec8-a68f-6c661e33be48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:09.353983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7ef0dc7c-c2e6-4ec8-a68f-6c661e33be48 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:19:09.355210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7ef0dc7c-c2e6-4ec8-a68f-6c661e33be48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:19:09.438530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 631/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:19:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:19:09.462637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321eb18-8c07-4bea-8575-fc4f1ad785a1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:09.475480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:09.573966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321eb18-8c07-4bea-8575-fc4f1ad785a1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:09.611404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333aa1b8-34a0-4b0b-b5e3-66f9772e0a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:09.612228 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333aa1b8-34a0-4b0b-b5e3-66f9772e0a48 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:09.612511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333aa1b8-34a0-4b0b-b5e3-66f9772e0a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:09.612785 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333aa1b8-34a0-4b0b-b5e3-66f9772e0a48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:09.624335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333aa1b8-34a0-4b0b-b5e3-66f9772e0a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-333aa1b8-34a0-4b0b-b5e3-66f9772e0a48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:19:09.631829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:09.632900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:09.633900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 632/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:19:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:09.639547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0dc7c-c2e6-4ec8-a68f-6c661e33be48 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:09.659056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:09.744775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0dc7c-c2e6-4ec8-a68f-6c661e33be48 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:09.786831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023e4b9-92e0-488f-8485-641e56d46380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:09.787504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023e4b9-92e0-488f-8485-641e56d46380 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:09.787784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023e4b9-92e0-488f-8485-641e56d46380 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:09.788061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023e4b9-92e0-488f-8485-641e56d46380 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:09.788845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023e4b9-92e0-488f-8485-641e56d46380 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:09.789155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023e4b9-92e0-488f-8485-641e56d46380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:09.790854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023e4b9-92e0-488f-8485-641e56d46380 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:09.799166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 632/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:19:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:09.805180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333aa1b8-34a0-4b0b-b5e3-66f9772e0a48 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:09.876269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:09.911091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333aa1b8-34a0-4b0b-b5e3-66f9772e0a48 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:09.948048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236aab7-3157-4d18-b104-f52f77c2ad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:09.949034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236aab7-3157-4d18-b104-f52f77c2ad21 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:09.949323 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236aab7-3157-4d18-b104-f52f77c2ad21 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:09.949594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236aab7-3157-4d18-b104-f52f77c2ad21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:09.961347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236aab7-3157-4d18-b104-f52f77c2ad21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:09.962816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236aab7-3157-4d18-b104-f52f77c2ad21 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7236aab7-3157-4d18-b104-f52f77c2ad21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:19:09.980529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:09.981509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:09.982593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:19:09.982593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:19:09.982593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:09.982593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:09.982593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 633/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:09.987800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023e4b9-92e0-488f-8485-641e56d46380 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:10.081339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:10.105134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023e4b9-92e0-488f-8485-641e56d46380 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:10.143538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8400e1-480d-4537-aeab-e4b97690acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:10.144167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8400e1-480d-4537-aeab-e4b97690acfc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:10.144446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8400e1-480d-4537-aeab-e4b97690acfc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:10.144717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8400e1-480d-4537-aeab-e4b97690acfc None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:10.145438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8400e1-480d-4537-aeab-e4b97690acfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:10.145780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8400e1-480d-4537-aeab-e4b97690acfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:10.147154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8400e1-480d-4537-aeab-e4b97690acfc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:10.159052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 633/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:10.164874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236aab7-3157-4d18-b104-f52f77c2ad21 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:10.269606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236aab7-3157-4d18-b104-f52f77c2ad21 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:10.288964 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:10.310535 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fd624-9aa2-49ae-b331-fa0a923ee680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:10.311354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fd624-9aa2-49ae-b331-fa0a923ee680 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:10.311639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fd624-9aa2-49ae-b331-fa0a923ee680 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:10.311913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fd624-9aa2-49ae-b331-fa0a923ee680 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:10.319541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fd624-9aa2-49ae-b331-fa0a923ee680 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:10.321027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fd624-9aa2-49ae-b331-fa0a923ee680 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-553fd624-9aa2-49ae-b331-fa0a923ee680 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:19:10.334941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:10.336379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:10.337466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 634/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:10.342177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8400e1-480d-4537-aeab-e4b97690acfc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:10.454026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8400e1-480d-4537-aeab-e4b97690acfc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:10.496043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7ea62-d0a3-4647-95c9-b2624476fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:10.496732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7ea62-d0a3-4647-95c9-b2624476fe19 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:10.497018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7ea62-d0a3-4647-95c9-b2624476fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:10.497292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7ea62-d0a3-4647-95c9-b2624476fe19 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:10.498133 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7ea62-d0a3-4647-95c9-b2624476fe19 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:10.498440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7ea62-d0a3-4647-95c9-b2624476fe19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:10.499887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7ea62-d0a3-4647-95c9-b2624476fe19 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:10.508713 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:10.522909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 634/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 4 18:19:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:10.529063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fd624-9aa2-49ae-b331-fa0a923ee680 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:10.635284 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fd624-9aa2-49ae-b331-fa0a923ee680 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:10.672840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f68f1-1ff5-4eb4-a7a3-9b4ff293f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:10.673619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f68f1-1ff5-4eb4-a7a3-9b4ff293f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:10.673906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f68f1-1ff5-4eb4-a7a3-9b4ff293f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:10.674182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f68f1-1ff5-4eb4-a7a3-9b4ff293f7b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:10.685123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f68f1-1ff5-4eb4-a7a3-9b4ff293f7b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:10.686580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f68f1-1ff5-4eb4-a7a3-9b4ff293f7b4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8d4f68f1-1ff5-4eb4-a7a3-9b4ff293f7b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:19:10.708715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:10.709703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:10.710734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:19:10.710734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:19:10.710734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:10.710734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:10.710734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 635/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:10.716816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7ea62-d0a3-4647-95c9-b2624476fe19 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:10.828506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7ea62-d0a3-4647-95c9-b2624476fe19 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:10.863321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7418df-fe5f-47ab-9701-4dcb2e1d3274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:10.863973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7418df-fe5f-47ab-9701-4dcb2e1d3274 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:10.864278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7418df-fe5f-47ab-9701-4dcb2e1d3274 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:10.864550 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7418df-fe5f-47ab-9701-4dcb2e1d3274 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:10.865268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7418df-fe5f-47ab-9701-4dcb2e1d3274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:10.865574 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7418df-fe5f-47ab-9701-4dcb2e1d3274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:10.866953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7418df-fe5f-47ab-9701-4dcb2e1d3274 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:10.878150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 635/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:10.884037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f68f1-1ff5-4eb4-a7a3-9b4ff293f7b4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:10.920678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:10.988528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f68f1-1ff5-4eb4-a7a3-9b4ff293f7b4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:11.025668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026e636-c8b7-4e11-ac42-3eefda28fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:11.026863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026e636-c8b7-4e11-ac42-3eefda28fa96 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:11.027145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026e636-c8b7-4e11-ac42-3eefda28fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:11.027413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026e636-c8b7-4e11-ac42-3eefda28fa96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:11.037273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026e636-c8b7-4e11-ac42-3eefda28fa96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:11.038992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026e636-c8b7-4e11-ac42-3eefda28fa96 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1026e636-c8b7-4e11-ac42-3eefda28fa96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:19:11.058515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:11.059515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:11.060471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:19:11.060471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:19:11.060471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:19:11.060471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:19:11.060471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:19:11.060471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:19:11.060471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:19:11.060471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:11.060471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 636/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:19:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:11.066301 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7418df-fe5f-47ab-9701-4dcb2e1d3274 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:11.128122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:11.172664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7418df-fe5f-47ab-9701-4dcb2e1d3274 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:11.213708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dd839-50e0-491c-89a4-26381efbd955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:11.214877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dd839-50e0-491c-89a4-26381efbd955 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:11.215256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dd839-50e0-491c-89a4-26381efbd955 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:11.215632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dd839-50e0-491c-89a4-26381efbd955 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:11.216928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dd839-50e0-491c-89a4-26381efbd955 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:11.217356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dd839-50e0-491c-89a4-26381efbd955 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:11.219564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dd839-50e0-491c-89a4-26381efbd955 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:11.236952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 636/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:11.243453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026e636-c8b7-4e11-ac42-3eefda28fa96 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:11.344655 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:11.353967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026e636-c8b7-4e11-ac42-3eefda28fa96 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:11.390911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db91474-5036-4076-bca2-6f69ae9e1e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:11.391847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91474-5036-4076-bca2-6f69ae9e1e0d None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:11.392159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91474-5036-4076-bca2-6f69ae9e1e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:11.392441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db91474-5036-4076-bca2-6f69ae9e1e0d None admin] PATH_INFO: `/v3/projects/f1d869e2da6945caba000577ff12025c/users/9edcf71253ee4c81a402fffe13128b97/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:11.394532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db91474-5036-4076-bca2-6f69ae9e1e0d None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d869e2da6945caba000577ff12025c, user_id=9edcf71253ee4c81a402fffe13128b97, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:11.395992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db91474-5036-4076-bca2-6f69ae9e1e0d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:11.411504 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 637/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Jun 4 18:19:11 2022] PUT /identity/v3/projects/f1d869e2da6945caba000577ff12025c/users/9edcf71253ee4c81a402fffe13128b97/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:19:13.626898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fef11-9de0-4086-babc-949cd0dbc491 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:13.627729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fef11-9de0-4086-babc-949cd0dbc491 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:13.627729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fef11-9de0-4086-babc-949cd0dbc491 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:13.629867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 637/1274] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:19:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:19:13.635303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c397e-0eb1-4fd2-882d-2398d921f5b3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:13.635866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c397e-0eb1-4fd2-882d-2398d921f5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:13.636168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c397e-0eb1-4fd2-882d-2398d921f5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:13.655445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-236c397e-0eb1-4fd2-882d-2398d921f5b3 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:19:13.656624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-236c397e-0eb1-4fd2-882d-2398d921f5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:19:13.729995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 638/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:19:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:19:13.754091 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fef11-9de0-4086-babc-949cd0dbc491 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:13.863497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fef11-9de0-4086-babc-949cd0dbc491 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:13.881254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:13.899439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7f2e9-21fa-4cd3-a411-ed56c02993ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:13.900265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f2e9-21fa-4cd3-a411-ed56c02993ae None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:13.900545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f2e9-21fa-4cd3-a411-ed56c02993ae None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:13.900819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f2e9-21fa-4cd3-a411-ed56c02993ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:13.911621 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7f2e9-21fa-4cd3-a411-ed56c02993ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d4b7f2e9-21fa-4cd3-a411-ed56c02993ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 18:19:13.919564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:13.920622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:13.921486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 638/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Jun 4 18:19:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:13.927110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c397e-0eb1-4fd2-882d-2398d921f5b3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:14.013983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:14.033722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c397e-0eb1-4fd2-882d-2398d921f5b3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:14.070053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b378-957d-4b97-adb1-eefaa0f3ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:14.070790 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b378-957d-4b97-adb1-eefaa0f3ab9b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:14.071151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b378-957d-4b97-adb1-eefaa0f3ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:14.071589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b378-957d-4b97-adb1-eefaa0f3ab9b None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:14.072204 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18b378-957d-4b97-adb1-eefaa0f3ab9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:14.072514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18b378-957d-4b97-adb1-eefaa0f3ab9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:14.073986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18b378-957d-4b97-adb1-eefaa0f3ab9b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:14.083679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 639/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Jun 4 18:19:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:14.090918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7f2e9-21fa-4cd3-a411-ed56c02993ae None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:14.201173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7f2e9-21fa-4cd3-a411-ed56c02993ae None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:14.244851 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7fb0d-690b-4592-b7fe-37a345e705c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:14.246044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7fb0d-690b-4592-b7fe-37a345e705c0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:14.246506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7fb0d-690b-4592-b7fe-37a345e705c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:14.246957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7fb0d-690b-4592-b7fe-37a345e705c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:14.264808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7fb0d-690b-4592-b7fe-37a345e705c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:14.266277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7fb0d-690b-4592-b7fe-37a345e705c0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a2f7fb0d-690b-4592-b7fe-37a345e705c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:19:14.285020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:14.286015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:14.287205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:19:14.287205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:19:14.287205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:14.287205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:14.287205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 639/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:14.292863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b378-957d-4b97-adb1-eefaa0f3ab9b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:14.402501 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b378-957d-4b97-adb1-eefaa0f3ab9b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:14.438763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac18720-3837-427e-b218-61aee80a29f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:14.439419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18720-3837-427e-b218-61aee80a29f4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:14.439701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18720-3837-427e-b218-61aee80a29f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:14.439976 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac18720-3837-427e-b218-61aee80a29f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:14.440725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac18720-3837-427e-b218-61aee80a29f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:14.441034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac18720-3837-427e-b218-61aee80a29f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:14.442412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac18720-3837-427e-b218-61aee80a29f4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:14.454651 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 640/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:14.461129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7fb0d-690b-4592-b7fe-37a345e705c0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:14.504402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:14.579085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7fb0d-690b-4592-b7fe-37a345e705c0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:14.624392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d7be-b022-4137-8351-c4a5529bba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:14.625258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d7be-b022-4137-8351-c4a5529bba36 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:14.625542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d7be-b022-4137-8351-c4a5529bba36 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:14.625817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d7be-b022-4137-8351-c4a5529bba36 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:14.634873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d7be-b022-4137-8351-c4a5529bba36 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:14.636391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d7be-b022-4137-8351-c4a5529bba36 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-0a69d7be-b022-4137-8351-c4a5529bba36 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 18:19:14.651258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:14.652256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:14.653308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 640/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:14.658913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac18720-3837-427e-b218-61aee80a29f4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:14.664887 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:14.777575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac18720-3837-427e-b218-61aee80a29f4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:14.812894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145fa8a-9d5e-466b-9256-11e025750e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:14.813568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145fa8a-9d5e-466b-9256-11e025750e0e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:14.813844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145fa8a-9d5e-466b-9256-11e025750e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:14.814117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145fa8a-9d5e-466b-9256-11e025750e0e None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:14.814953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145fa8a-9d5e-466b-9256-11e025750e0e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:14.815264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145fa8a-9d5e-466b-9256-11e025750e0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:14.816741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145fa8a-9d5e-466b-9256-11e025750e0e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:14.833849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 641/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Jun 4 18:19:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:14.840445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d7be-b022-4137-8351-c4a5529bba36 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:14.940560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:14.953373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d7be-b022-4137-8351-c4a5529bba36 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:14.986712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e1ba1-650c-4e44-8f57-eef6ad6775e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:14.987356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e1ba1-650c-4e44-8f57-eef6ad6775e0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:14.987637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e1ba1-650c-4e44-8f57-eef6ad6775e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:14.987912 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e1ba1-650c-4e44-8f57-eef6ad6775e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:15.060969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e1ba1-650c-4e44-8f57-eef6ad6775e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:15.062361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e1ba1-650c-4e44-8f57-eef6ad6775e0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:15.154585 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:15.169211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 641/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Jun 4 18:19:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 18:19:15.175210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145fa8a-9d5e-466b-9256-11e025750e0e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:15.238589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:15.287736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145fa8a-9d5e-466b-9256-11e025750e0e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:15.325000 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd0e31-cad4-40bb-a949-fc026f646bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:15.325737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0e31-cad4-40bb-a949-fc026f646bfa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:15.326021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0e31-cad4-40bb-a949-fc026f646bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:15.326296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0e31-cad4-40bb-a949-fc026f646bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:15.336593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd0e31-cad4-40bb-a949-fc026f646bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:15.338062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd0e31-cad4-40bb-a949-fc026f646bfa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c2bd0e31-cad4-40bb-a949-fc026f646bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 18:19:15.357196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:15.358194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:15.359102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 18:19:15.359102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 18:19:15.359102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 18:19:15.359102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:15.359102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 642/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 18:19:15.364426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e1ba1-650c-4e44-8f57-eef6ad6775e0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:15.469053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e1ba1-650c-4e44-8f57-eef6ad6775e0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:15.503769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3273082-ddc4-4512-8ad4-688330ee7c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:15.504454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3273082-ddc4-4512-8ad4-688330ee7c69 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:15.504734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3273082-ddc4-4512-8ad4-688330ee7c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:15.505009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3273082-ddc4-4512-8ad4-688330ee7c69 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:15.505728 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3273082-ddc4-4512-8ad4-688330ee7c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:15.506035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3273082-ddc4-4512-8ad4-688330ee7c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:15.507384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3273082-ddc4-4512-8ad4-688330ee7c69 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:15.519150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 642/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Jun 4 18:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:15.525046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd0e31-cad4-40bb-a949-fc026f646bfa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:15.634499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd0e31-cad4-40bb-a949-fc026f646bfa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:15.648908 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:15.682399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bc69c-9fa7-4b79-aba9-9bda35632852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:15.683538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bc69c-9fa7-4b79-aba9-9bda35632852 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:15.683821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bc69c-9fa7-4b79-aba9-9bda35632852 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:15.684119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bc69c-9fa7-4b79-aba9-9bda35632852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:15.691031 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bc69c-9fa7-4b79-aba9-9bda35632852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:15.692512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bc69c-9fa7-4b79-aba9-9bda35632852 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-df8bc69c-9fa7-4b79-aba9-9bda35632852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 18:19:15.706435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:15.707496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:15.708412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 18:19:15.708412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 18:19:15.708412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 18:19:15.708412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 18:19:15.708412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 18:19:15.708412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 18:19:15.708412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 18:19:15.708412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 04 18:19:15.708412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 643/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Jun 4 18:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:15.716666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3273082-ddc4-4512-8ad4-688330ee7c69 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:15.768039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:15.822848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3273082-ddc4-4512-8ad4-688330ee7c69 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:15.858447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f918f9e-997b-4c06-9b0e-39d73201b586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:15.859103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f918f9e-997b-4c06-9b0e-39d73201b586 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:15.859381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f918f9e-997b-4c06-9b0e-39d73201b586 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:15.859655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f918f9e-997b-4c06-9b0e-39d73201b586 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:15.860475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f918f9e-997b-4c06-9b0e-39d73201b586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:15.860781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f918f9e-997b-4c06-9b0e-39d73201b586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:15.862243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f918f9e-997b-4c06-9b0e-39d73201b586 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:15.875383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 643/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Jun 4 18:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:15.885356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bc69c-9fa7-4b79-aba9-9bda35632852 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:15.995374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bc69c-9fa7-4b79-aba9-9bda35632852 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:16.032300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae66197-76f5-4444-9606-9cefbac0f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:16.032937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66197-76f5-4444-9606-9cefbac0f9bc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:16.033217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66197-76f5-4444-9606-9cefbac0f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:16.033487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae66197-76f5-4444-9606-9cefbac0f9bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:16.034393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae66197-76f5-4444-9606-9cefbac0f9bc None admin] RBAC: Adding query filter params (role.id=9f557e97d94b4b499a6765419452e1ef, scope.project.id=f1d869e2da6945caba000577ff12025c, user.id=9edcf71253ee4c81a402fffe13128b97) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:16.034852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae66197-76f5-4444-9606-9cefbac0f9bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:16.036561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae66197-76f5-4444-9606-9cefbac0f9bc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:16.044735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 644/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Jun 4 18:19:15 2022] GET /identity/v3/role_assignments?user.id=9edcf71253ee4c81a402fffe13128b97&scope.project.id=f1d869e2da6945caba000577ff12025c&role.id=9f557e97d94b4b499a6765419452e1ef => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:18.278212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6546-fb03-4b92-a653-71d6ba920e75 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:18.278765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6546-fb03-4b92-a653-71d6ba920e75 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:18.278765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6546-fb03-4b92-a653-71d6ba920e75 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:18.280130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 644/1288] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:19:18.288876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dd0b0-b403-4548-b8b6-a99c74f71c65 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:18.289307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dd0b0-b403-4548-b8b6-a99c74f71c65 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:18.289449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dd0b0-b403-4548-b8b6-a99c74f71c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:18.313947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c09dd0b0-b403-4548-b8b6-a99c74f71c65 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:19:18.315159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c09dd0b0-b403-4548-b8b6-a99c74f71c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:19:18.346425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:18.395186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 645/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:19:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:19:18.420891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a6546-fb03-4b92-a653-71d6ba920e75 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:18.541523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a6546-fb03-4b92-a653-71d6ba920e75 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:18.556348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:18.583349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a56e8c-442a-4724-a107-a2aa0e108c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:18.584187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a56e8c-442a-4724-a107-a2aa0e108c5e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:18.584469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a56e8c-442a-4724-a107-a2aa0e108c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:18.584741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a56e8c-442a-4724-a107-a2aa0e108c5e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:18.585399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a56e8c-442a-4724-a107-a2aa0e108c5e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:18.586788 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a56e8c-442a-4724-a107-a2aa0e108c5e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-42a56e8c-442a-4724-a107-a2aa0e108c5e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:18.599807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:18.600961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:18.601951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 645/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 4 18:19:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:18.608107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dd0b0-b403-4548-b8b6-a99c74f71c65 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:18.722749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dd0b0-b403-4548-b8b6-a99c74f71c65 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:18.765126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1598709-2330-4c3d-aff4-d7f59cb625b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:18.765828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1598709-2330-4c3d-aff4-d7f59cb625b4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:18.766100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1598709-2330-4c3d-aff4-d7f59cb625b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:18.766367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1598709-2330-4c3d-aff4-d7f59cb625b4 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:18.767069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1598709-2330-4c3d-aff4-d7f59cb625b4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:18.767367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1598709-2330-4c3d-aff4-d7f59cb625b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:18.768764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1598709-2330-4c3d-aff4-d7f59cb625b4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:18.773631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 646/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Jun 4 18:19:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:18.780421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a56e8c-442a-4724-a107-a2aa0e108c5e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:18.889231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a56e8c-442a-4724-a107-a2aa0e108c5e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:18.925676 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40a5bf-0c35-458c-af0f-7a438a2790a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:18.926330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40a5bf-0c35-458c-af0f-7a438a2790a8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:18.926612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40a5bf-0c35-458c-af0f-7a438a2790a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:18.926889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40a5bf-0c35-458c-af0f-7a438a2790a8 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:18.927597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40a5bf-0c35-458c-af0f-7a438a2790a8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:18.927908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40a5bf-0c35-458c-af0f-7a438a2790a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:18.929330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40a5bf-0c35-458c-af0f-7a438a2790a8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:18.933931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 646/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Jun 4 18:19:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:21.206708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738f7f8-faf2-45de-8d44-865d88acf6f1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:21.207556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738f7f8-faf2-45de-8d44-865d88acf6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:21.207556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738f7f8-faf2-45de-8d44-865d88acf6f1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:21.209784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 647/1293] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:19:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:19:21.217736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d885b-37a7-4e99-bb84-8e4a7e2530c2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:21.218177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d885b-37a7-4e99-bb84-8e4a7e2530c2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:21.218276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d885b-37a7-4e99-bb84-8e4a7e2530c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:21.236558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f26d885b-37a7-4e99-bb84-8e4a7e2530c2 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:19:21.237736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f26d885b-37a7-4e99-bb84-8e4a7e2530c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:19:21.268913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:21.309969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 647/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:19:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:19:21.345508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738f7f8-faf2-45de-8d44-865d88acf6f1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:21.394637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:21.481540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738f7f8-faf2-45de-8d44-865d88acf6f1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:21.517135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080b234-720e-4948-917d-61f570e4983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:21.517793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080b234-720e-4948-917d-61f570e4983a None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:21.518084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080b234-720e-4948-917d-61f570e4983a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:21.518362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080b234-720e-4948-917d-61f570e4983a None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:21.519088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080b234-720e-4948-917d-61f570e4983a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:21.520506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080b234-720e-4948-917d-61f570e4983a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:21.541918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 648/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Jun 4 18:19:21 2022] POST /identity/v3/services => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:19:23.778990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918385-b91a-44c0-b9e9-5d5784404ba5 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:23.779567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918385-b91a-44c0-b9e9-5d5784404ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:23.779567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918385-b91a-44c0-b9e9-5d5784404ba5 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:23.781733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 648/1296] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:19:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:19:23.789679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b9fca-f1db-4497-bbd7-97c820847472 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:23.790147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b9fca-f1db-4497-bbd7-97c820847472 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:23.790612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b9fca-f1db-4497-bbd7-97c820847472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:23.809864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0b4b9fca-f1db-4497-bbd7-97c820847472 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:19:23.811028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0b4b9fca-f1db-4497-bbd7-97c820847472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:19:23.888370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 649/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:19:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 18:19:23.923231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4918385-b91a-44c0-b9e9-5d5784404ba5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:24.029695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4918385-b91a-44c0-b9e9-5d5784404ba5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:24.065286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9003875-3dc9-477f-b8f9-0db71d2244a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:24.066079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9003875-3dc9-477f-b8f9-0db71d2244a4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:24.066358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9003875-3dc9-477f-b8f9-0db71d2244a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:24.066625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9003875-3dc9-477f-b8f9-0db71d2244a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:24.067277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9003875-3dc9-477f-b8f9-0db71d2244a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:24.068690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9003875-3dc9-477f-b8f9-0db71d2244a4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c9003875-3dc9-477f-b8f9-0db71d2244a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:24.080538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:24.081655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:24.082602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 649/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 4 18:19:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:24.087945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b9fca-f1db-4497-bbd7-97c820847472 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:24.110024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:24.333171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b9fca-f1db-4497-bbd7-97c820847472 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:24.368587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fac3f-66ac-4583-a9ed-73b894dca17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:24.369246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fac3f-66ac-4583-a9ed-73b894dca17f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:24.369528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fac3f-66ac-4583-a9ed-73b894dca17f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:24.369806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fac3f-66ac-4583-a9ed-73b894dca17f None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:24.370520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fac3f-66ac-4583-a9ed-73b894dca17f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:24.370834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fac3f-66ac-4583-a9ed-73b894dca17f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:24.372403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fac3f-66ac-4583-a9ed-73b894dca17f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:24.377678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 650/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Jun 4 18:19:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:24.384063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9003875-3dc9-477f-b8f9-0db71d2244a4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:24.421646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:24.501304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9003875-3dc9-477f-b8f9-0db71d2244a4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:24.536081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e77460-95e0-4ce0-bb77-470b9cac2990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:24.536736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e77460-95e0-4ce0-bb77-470b9cac2990 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:24.536981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e77460-95e0-4ce0-bb77-470b9cac2990 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:24.537285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e77460-95e0-4ce0-bb77-470b9cac2990 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:24.538071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e77460-95e0-4ce0-bb77-470b9cac2990 None admin] RBAC: Adding query filter params (interface=public, service_id=ca543fbefac64471a76470a0266f2808, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:24.538382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e77460-95e0-4ce0-bb77-470b9cac2990 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:24.539768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e77460-95e0-4ce0-bb77-470b9cac2990 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:24.545276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 650/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Jun 4 18:19:24 2022] GET /identity/v3/endpoints?service_id=ca543fbefac64471a76470a0266f2808&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:24.551244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fac3f-66ac-4583-a9ed-73b894dca17f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:24.639321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:24.668898 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fac3f-66ac-4583-a9ed-73b894dca17f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:24.703479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2334bb-a59e-4d3f-8a2a-59ea6d3035c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:24.704161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2334bb-a59e-4d3f-8a2a-59ea6d3035c2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:24.704442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2334bb-a59e-4d3f-8a2a-59ea6d3035c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:24.704720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2334bb-a59e-4d3f-8a2a-59ea6d3035c2 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:24.705401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2334bb-a59e-4d3f-8a2a-59ea6d3035c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:24.706784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2334bb-a59e-4d3f-8a2a-59ea6d3035c2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:24.713716 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 651/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Jun 4 18:19:24 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:19:26.908381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8d46f-1174-451d-b744-0f5693fad97a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:26.909282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8d46f-1174-451d-b744-0f5693fad97a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:26.909282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8d46f-1174-451d-b744-0f5693fad97a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:26.911499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 651/1302] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:19:26.918733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4c94b-57ea-4d10-93d7-95dc929dea5b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:26.919195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4c94b-57ea-4d10-93d7-95dc929dea5b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:26.919195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4c94b-57ea-4d10-93d7-95dc929dea5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:26.937934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-45e4c94b-57ea-4d10-93d7-95dc929dea5b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:19:26.939115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-45e4c94b-57ea-4d10-93d7-95dc929dea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:19:27.011513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 652/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:19:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 18:19:27.047742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8d46f-1174-451d-b744-0f5693fad97a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:27.167184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:27.175814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8d46f-1174-451d-b744-0f5693fad97a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:27.211647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997216f-5c84-438f-a881-a09ecf53dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:27.212474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997216f-5c84-438f-a881-a09ecf53dfaf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:27.212754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997216f-5c84-438f-a881-a09ecf53dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:27.213021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997216f-5c84-438f-a881-a09ecf53dfaf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:27.213671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997216f-5c84-438f-a881-a09ecf53dfaf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:27.215091 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997216f-5c84-438f-a881-a09ecf53dfaf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d997216f-5c84-438f-a881-a09ecf53dfaf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 18:19:27.227615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 18:19:27.228873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 04 18:19:27.230835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 652/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Jun 4 18:19:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 18:19:27.236696 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4c94b-57ea-4d10-93d7-95dc929dea5b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:27.330904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:27.355366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4c94b-57ea-4d10-93d7-95dc929dea5b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:27.391276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908045-7c69-4051-94c1-b97013da17bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:27.391921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908045-7c69-4051-94c1-b97013da17bb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:27.392232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908045-7c69-4051-94c1-b97013da17bb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:27.392503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908045-7c69-4051-94c1-b97013da17bb None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:27.393205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02908045-7c69-4051-94c1-b97013da17bb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:19:27.393500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02908045-7c69-4051-94c1-b97013da17bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:27.394881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02908045-7c69-4051-94c1-b97013da17bb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:27.400041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 653/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Jun 4 18:19:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:19:27.406500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997216f-5c84-438f-a881-a09ecf53dfaf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:19:27.522781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997216f-5c84-438f-a881-a09ecf53dfaf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:19:27.558519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ce24e-075d-4a82-94c0-a5f140f3131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:19:27.559729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ce24e-075d-4a82-94c0-a5f140f3131c None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:19:27.560051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ce24e-075d-4a82-94c0-a5f140f3131c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:19:27.560322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ce24e-075d-4a82-94c0-a5f140f3131c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:19:27.561059 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ce24e-075d-4a82-94c0-a5f140f3131c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:19:27.562441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ce24e-075d-4a82-94c0-a5f140f3131c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:19:27.590387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 653/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Jun 4 18:19:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:19:37.397406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=30 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:19:37.582702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:32.037885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac804dc-f72f-4b6e-a61d-762cdbb2252d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:32.038829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac804dc-f72f-4b6e-a61d-762cdbb2252d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:32.039596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac804dc-f72f-4b6e-a61d-762cdbb2252d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:32.041160 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 654/1307] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:32.046996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465d5ad-7452-4c32-9d79-dfee4faeb00f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:32.047767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465d5ad-7452-4c32-9d79-dfee4faeb00f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:32.048227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465d5ad-7452-4c32-9d79-dfee4faeb00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:32.176641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4465d5ad-7452-4c32-9d79-dfee4faeb00f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:32.177896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4465d5ad-7452-4c32-9d79-dfee4faeb00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:32.309475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 654/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:20:32.352276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843c77-4a76-4687-ada8-1595af660d2c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:32.352616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843c77-4a76-4687-ada8-1595af660d2c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:32.352819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13843c77-4a76-4687-ada8-1595af660d2c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:32.354449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 655/1309] 10.222.0.39 () {54 vars in 964 bytes} [Sat Jun 4 18:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:32.362360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c97c6-9141-4228-b7c6-f7efb3a0fae2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:32.362658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c97c6-9141-4228-b7c6-f7efb3a0fae2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:32.362942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c97c6-9141-4228-b7c6-f7efb3a0fae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:32.541600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5b4c97c6-9141-4228-b7c6-f7efb3a0fae2 None None] MFA Rules not processed for user `37c4400204794a54957ccf28df938f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:32.543256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5b4c97c6-9141-4228-b7c6-f7efb3a0fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:32.594122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:32.666282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 655/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Sat Jun 4 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:20:32.675335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13843c77-4a76-4687-ada8-1595af660d2c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:20:32.677425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-13843c77-4a76-4687-ada8-1595af660d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:32.803693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13843c77-4a76-4687-ada8-1595af660d2c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:20:32.890362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530412e-2b2e-4e40-bb5c-54bddf48cc49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:20:32.891025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530412e-2b2e-4e40-bb5c-54bddf48cc49 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:32.891316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530412e-2b2e-4e40-bb5c-54bddf48cc49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:32.891590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530412e-2b2e-4e40-bb5c-54bddf48cc49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:32.893253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3530412e-2b2e-4e40-bb5c-54bddf48cc49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:32.953041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:33.019158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530412e-2b2e-4e40-bb5c-54bddf48cc49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:20:33.020930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530412e-2b2e-4e40-bb5c-54bddf48cc49 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:20:33.043110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 656/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:20:35.656044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c4ea0-448e-4780-9c3d-943498f1bd03 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:35.656540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c4ea0-448e-4780-9c3d-943498f1bd03 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:35.656619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c4ea0-448e-4780-9c3d-943498f1bd03 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:35.658086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 656/1312] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:35.663576 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49810d6d-7801-41b8-a25f-f579b4bbc211 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:35.664394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49810d6d-7801-41b8-a25f-f579b4bbc211 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:35.664934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49810d6d-7801-41b8-a25f-f579b4bbc211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:35.749769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-49810d6d-7801-41b8-a25f-f579b4bbc211 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:35.750975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-49810d6d-7801-41b8-a25f-f579b4bbc211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:35.851056 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 657/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:20:35.904305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f424927-3ffe-47bd-8b71-53fffdedac1f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:35.904565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f424927-3ffe-47bd-8b71-53fffdedac1f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:35.904861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f424927-3ffe-47bd-8b71-53fffdedac1f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:35.906282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 657/1314] 10.222.0.39 () {54 vars in 964 bytes} [Sat Jun 4 18:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:35.912578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04cee1-5d9c-4c92-8420-8c8c01c2c18e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:35.912971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04cee1-5d9c-4c92-8420-8c8c01c2c18e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:35.913306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04cee1-5d9c-4c92-8420-8c8c01c2c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:35.924859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:35.997521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fe04cee1-5d9c-4c92-8420-8c8c01c2c18e None None] MFA Rules not processed for user `37c4400204794a54957ccf28df938f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:35.998806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fe04cee1-5d9c-4c92-8420-8c8c01c2c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:36.081159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 658/1315] 10.222.0.39 () {58 vars in 1061 bytes} [Sat Jun 4 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:20:36.090610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f424927-3ffe-47bd-8b71-53fffdedac1f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:20:36.092273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2f424927-3ffe-47bd-8b71-53fffdedac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:36.205034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f424927-3ffe-47bd-8b71-53fffdedac1f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:20:36.274735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:36.277517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd79ae-aaef-482c-baa8-e4d7cb263b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:20:36.278191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd79ae-aaef-482c-baa8-e4d7cb263b44 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:36.278488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd79ae-aaef-482c-baa8-e4d7cb263b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:36.278773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd79ae-aaef-482c-baa8-e4d7cb263b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:36.280962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-29dd79ae-aaef-482c-baa8-e4d7cb263b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:36.392174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd79ae-aaef-482c-baa8-e4d7cb263b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:20:36.393625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd79ae-aaef-482c-baa8-e4d7cb263b44 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:20:36.411362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 658/1316] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:20:39.232894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563b25-dd53-4bbf-9beb-71afcb896160 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:39.233503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563b25-dd53-4bbf-9beb-71afcb896160 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:39.233503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34563b25-dd53-4bbf-9beb-71afcb896160 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:39.234861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 659/1317] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:39.241523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c47b2-54d6-4ca4-9aa8-a022d526e6d9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:39.242245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c47b2-54d6-4ca4-9aa8-a022d526e6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:39.242393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c47b2-54d6-4ca4-9aa8-a022d526e6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:39.317291 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a65c47b2-54d6-4ca4-9aa8-a022d526e6d9 None None] MFA Rules not processed for user `dbabdd5b42334ed08a87a2bea3cbaace`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:39.318520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a65c47b2-54d6-4ca4-9aa8-a022d526e6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:39.374295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:39.425896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 659/1318] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:20:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:20:39.466939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34563b25-dd53-4bbf-9beb-71afcb896160 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:20:39.469444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-34563b25-dd53-4bbf-9beb-71afcb896160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:39.586304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34563b25-dd53-4bbf-9beb-71afcb896160 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:20:39.589114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:39.662959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585cb68-70ac-4ac0-a809-d22b61008140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:20:39.663594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585cb68-70ac-4ac0-a809-d22b61008140 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:39.664214 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585cb68-70ac-4ac0-a809-d22b61008140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:39.664512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585cb68-70ac-4ac0-a809-d22b61008140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:39.666124 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d585cb68-70ac-4ac0-a809-d22b61008140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:39.775463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585cb68-70ac-4ac0-a809-d22b61008140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:20:39.777009 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585cb68-70ac-4ac0-a809-d22b61008140 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:20:39.796188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 660/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:20:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:20:42.605338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0897499-7318-4ddd-bd67-a7340cd2fe95 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:42.605870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0897499-7318-4ddd-bd67-a7340cd2fe95 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:42.605870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0897499-7318-4ddd-bd67-a7340cd2fe95 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:42.607183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 660/1320] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:42.612828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da2450-c03b-42cb-923c-cff6af62ec46 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:42.613266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da2450-c03b-42cb-923c-cff6af62ec46 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:42.613359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da2450-c03b-42cb-923c-cff6af62ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:42.655901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:42.683202 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-42da2450-c03b-42cb-923c-cff6af62ec46 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:42.684434 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-42da2450-c03b-42cb-923c-cff6af62ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:42.782029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 661/1321] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:20:42.821004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0897499-7318-4ddd-bd67-a7340cd2fe95 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:20:42.822527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d0897499-7318-4ddd-bd67-a7340cd2fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:42.942574 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0897499-7318-4ddd-bd67-a7340cd2fe95 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:20:43.020851 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f1d8a-b26c-4eea-b8ec-fe80ac1e9275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:20:43.021499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f1d8a-b26c-4eea-b8ec-fe80ac1e9275 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:43.021780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f1d8a-b26c-4eea-b8ec-fe80ac1e9275 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:43.022044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f1d8a-b26c-4eea-b8ec-fe80ac1e9275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:43.023719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-976f1d8a-b26c-4eea-b8ec-fe80ac1e9275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:43.031385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:43.143972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f1d8a-b26c-4eea-b8ec-fe80ac1e9275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:20:43.145476 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f1d8a-b26c-4eea-b8ec-fe80ac1e9275 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:20:43.167484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 661/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:20:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:20:46.107691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992b6a8-9cd7-4d9f-b4e2-8911ea2394bf None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:46.108268 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992b6a8-9cd7-4d9f-b4e2-8911ea2394bf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:46.108268 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992b6a8-9cd7-4d9f-b4e2-8911ea2394bf None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:46.109703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 662/1323] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:46.115275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea55f-1898-43a6-a999-837aa4034822 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:46.115671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea55f-1898-43a6-a999-837aa4034822 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:46.115831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea55f-1898-43a6-a999-837aa4034822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:46.186431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-413ea55f-1898-43a6-a999-837aa4034822 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:46.187737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-413ea55f-1898-43a6-a999-837aa4034822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:46.246171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:46.286118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 662/1324] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:20:46.322146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992b6a8-9cd7-4d9f-b4e2-8911ea2394bf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:20:46.324352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e992b6a8-9cd7-4d9f-b4e2-8911ea2394bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:46.432935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992b6a8-9cd7-4d9f-b4e2-8911ea2394bf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:20:46.445263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:46.507205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891da50-3ecb-40b4-8d76-677cda49bb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:20:46.507857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891da50-3ecb-40b4-8d76-677cda49bb50 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:46.508171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891da50-3ecb-40b4-8d76-677cda49bb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:46.508446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891da50-3ecb-40b4-8d76-677cda49bb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:46.510135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4891da50-3ecb-40b4-8d76-677cda49bb50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:46.627189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891da50-3ecb-40b4-8d76-677cda49bb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:20:46.628676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891da50-3ecb-40b4-8d76-677cda49bb50 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:20:46.647160 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 663/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:20:48.968688 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323ef7-765e-4e4d-928a-ea6138a58e3a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:48.969276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323ef7-765e-4e4d-928a-ea6138a58e3a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:48.969276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323ef7-765e-4e4d-928a-ea6138a58e3a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:48.970650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 663/1326] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:48.976435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985805a-c17f-41a7-ad54-0f5b4cfad754 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:48.976863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985805a-c17f-41a7-ad54-0f5b4cfad754 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:48.976994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985805a-c17f-41a7-ad54-0f5b4cfad754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:49.028810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:49.054188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b985805a-c17f-41a7-ad54-0f5b4cfad754 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:49.056658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b985805a-c17f-41a7-ad54-0f5b4cfad754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:49.160462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 664/1327] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:20:49.196413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b323ef7-765e-4e4d-928a-ea6138a58e3a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:20:49.198051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5b323ef7-765e-4e4d-928a-ea6138a58e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:49.310938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b323ef7-765e-4e4d-928a-ea6138a58e3a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:20:49.395443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e1a7d-756a-4309-a936-ae08541a17c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:20:49.396135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1a7d-756a-4309-a936-ae08541a17c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:49.396420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1a7d-756a-4309-a936-ae08541a17c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:49.396694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1a7d-756a-4309-a936-ae08541a17c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:49.398343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5c2e1a7d-756a-4309-a936-ae08541a17c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:49.417095 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:49.514554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e1a7d-756a-4309-a936-ae08541a17c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:20:49.516372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e1a7d-756a-4309-a936-ae08541a17c7 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:20:49.535911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 664/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:20:51.856328 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4b7f1-f608-45ca-a61b-e550e1551fda None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:51.856926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4b7f1-f608-45ca-a61b-e550e1551fda None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:51.856926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4b7f1-f608-45ca-a61b-e550e1551fda None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:51.858214 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 665/1329] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:51.864030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4ff1-a9ed-4038-a1ef-ec234605d147 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:51.864485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4ff1-a9ed-4038-a1ef-ec234605d147 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:51.864726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4ff1-a9ed-4038-a1ef-ec234605d147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:51.933891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6ebe4ff1-a9ed-4038-a1ef-ec234605d147 None None] MFA Rules not processed for user `dbabdd5b42334ed08a87a2bea3cbaace`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:51.935097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6ebe4ff1-a9ed-4038-a1ef-ec234605d147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:52.004954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:52.039925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 665/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:20:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:20:52.077303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4b7f1-f608-45ca-a61b-e550e1551fda None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:20:52.078825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a1f4b7f1-f608-45ca-a61b-e550e1551fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:52.185608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4b7f1-f608-45ca-a61b-e550e1551fda None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:20:52.205720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:52.262317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cf40a-bd4d-4902-85ed-05eeafca7484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:20:52.262971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf40a-bd4d-4902-85ed-05eeafca7484 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:52.263251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf40a-bd4d-4902-85ed-05eeafca7484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:52.263521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cf40a-bd4d-4902-85ed-05eeafca7484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:52.265185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1e6cf40a-bd4d-4902-85ed-05eeafca7484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:52.381745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cf40a-bd4d-4902-85ed-05eeafca7484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:20:52.383200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cf40a-bd4d-4902-85ed-05eeafca7484 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:20:52.403119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 666/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:20:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:20:54.909807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d26575-f602-4e86-9692-b127ac6eaad8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:54.910313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d26575-f602-4e86-9692-b127ac6eaad8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:54.910426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d26575-f602-4e86-9692-b127ac6eaad8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:54.911832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 666/1332] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:54.917523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcc8d8-ed30-4781-bc98-eb57f5be48fc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:54.917956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcc8d8-ed30-4781-bc98-eb57f5be48fc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:54.918141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcc8d8-ed30-4781-bc98-eb57f5be48fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:54.986259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:54.990374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a6dcc8d8-ed30-4781-bc98-eb57f5be48fc None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:54.991809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a6dcc8d8-ed30-4781-bc98-eb57f5be48fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:55.092868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 667/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:20:55.128750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d26575-f602-4e86-9692-b127ac6eaad8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:20:55.130260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b3d26575-f602-4e86-9692-b127ac6eaad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:55.251155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d26575-f602-4e86-9692-b127ac6eaad8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:20:55.335863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca393b-dae7-4eb7-a798-bd33e2aac7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:20:55.336550 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca393b-dae7-4eb7-a798-bd33e2aac7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:55.336830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca393b-dae7-4eb7-a798-bd33e2aac7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:55.337103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca393b-dae7-4eb7-a798-bd33e2aac7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:55.338843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1aca393b-dae7-4eb7-a798-bd33e2aac7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:55.368112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:55.459534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca393b-dae7-4eb7-a798-bd33e2aac7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:20:55.461041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca393b-dae7-4eb7-a798-bd33e2aac7a1 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:20:55.481066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 667/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:20:57.797060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4528c9-49eb-48d9-bcfb-78ae56fb1e99 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:57.797880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4528c9-49eb-48d9-bcfb-78ae56fb1e99 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:57.797880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4528c9-49eb-48d9-bcfb-78ae56fb1e99 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:57.799668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 668/1335] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:20:57.808221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f6880-9334-438d-b0db-e15a40030678 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:57.808682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f6880-9334-438d-b0db-e15a40030678 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:57.808785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f6880-9334-438d-b0db-e15a40030678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:57.883321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6b3f6880-9334-438d-b0db-e15a40030678 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:20:57.884592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6b3f6880-9334-438d-b0db-e15a40030678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:57.964306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:57.991794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 668/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:20:58.036164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4528c9-49eb-48d9-bcfb-78ae56fb1e99 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:20:58.038588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bd4528c9-49eb-48d9-bcfb-78ae56fb1e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:58.150303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4528c9-49eb-48d9-bcfb-78ae56fb1e99 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:20:58.182799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:20:58.229423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a47c5a-b257-4326-b8da-4c407deeb864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:20:58.230072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a47c5a-b257-4326-b8da-4c407deeb864 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:20:58.230377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a47c5a-b257-4326-b8da-4c407deeb864 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:20:58.230627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a47c5a-b257-4326-b8da-4c407deeb864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:20:58.232278 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-68a47c5a-b257-4326-b8da-4c407deeb864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:20:58.352593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a47c5a-b257-4326-b8da-4c407deeb864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:20:58.354317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a47c5a-b257-4326-b8da-4c407deeb864 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:20:58.375437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 669/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:01.261702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab31c-3754-4bb1-9445-fc1e87e1b949 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:01.262273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab31c-3754-4bb1-9445-fc1e87e1b949 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:01.262273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab31c-3754-4bb1-9445-fc1e87e1b949 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:01.263658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 669/1338] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:01.270023 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db1f06-8715-4e24-800e-b6e92d46ba9b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:01.270772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db1f06-8715-4e24-800e-b6e92d46ba9b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:01.270930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db1f06-8715-4e24-800e-b6e92d46ba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:01.342608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b1db1f06-8715-4e24-800e-b6e92d46ba9b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:01.343823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b1db1f06-8715-4e24-800e-b6e92d46ba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:01.353557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:01.446057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 670/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:01.484043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ab31c-3754-4bb1-9445-fc1e87e1b949 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:01.485597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8c2ab31c-3754-4bb1-9445-fc1e87e1b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:01.613369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ab31c-3754-4bb1-9445-fc1e87e1b949 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:01.706706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e204c-93ed-44f4-be8c-05b66aa27b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:01.707373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e204c-93ed-44f4-be8c-05b66aa27b52 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:01.707655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e204c-93ed-44f4-be8c-05b66aa27b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:01.707924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e204c-93ed-44f4-be8c-05b66aa27b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:01.709634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-260e204c-93ed-44f4-be8c-05b66aa27b52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:01.756994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:01.855497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e204c-93ed-44f4-be8c-05b66aa27b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:01.857004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e204c-93ed-44f4-be8c-05b66aa27b52 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:01.884539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 670/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:06.418354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8d76-6753-4c62-8e66-329fc06ad827 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:06.418878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8d76-6753-4c62-8e66-329fc06ad827 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:06.418878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8d76-6753-4c62-8e66-329fc06ad827 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:06.420496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 671/1341] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:06.425715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67797d4-e780-424c-9587-315ce741cdca None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:06.426135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67797d4-e780-424c-9587-315ce741cdca None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:06.426322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67797d4-e780-424c-9587-315ce741cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:06.502569 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f67797d4-e780-424c-9587-315ce741cdca None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:06.503775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f67797d4-e780-424c-9587-315ce741cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:06.600409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:06.614796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 671/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:06.653575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8d76-6753-4c62-8e66-329fc06ad827 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:06.656030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-268f8d76-6753-4c62-8e66-329fc06ad827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:06.760597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8d76-6753-4c62-8e66-329fc06ad827 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:06.764499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250f5d8-891e-4544-b9da-fac617f91bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:06.765175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250f5d8-891e-4544-b9da-fac617f91bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:06.765460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250f5d8-891e-4544-b9da-fac617f91bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:06.765737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250f5d8-891e-4544-b9da-fac617f91bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:06.776280 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250f5d8-891e-4544-b9da-fac617f91bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:06.777743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250f5d8-891e-4544-b9da-fac617f91bd4 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:06.787243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 672/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:09.620120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42efe0-0589-48dc-a493-5f6ff843c80d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:09.620120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42efe0-0589-48dc-a493-5f6ff843c80d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:09.621206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42efe0-0589-48dc-a493-5f6ff843c80d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:09.621848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 672/1344] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:09.627174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e450cb-b955-439d-b568-7bf3a0f571e9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:09.627595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e450cb-b955-439d-b568-7bf3a0f571e9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:09.627827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e450cb-b955-439d-b568-7bf3a0f571e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:09.657319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a6e450cb-b955-439d-b568-7bf3a0f571e9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:09.658499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a6e450cb-b955-439d-b568-7bf3a0f571e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:09.687940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:09.741499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 673/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:09.779876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42efe0-0589-48dc-a493-5f6ff843c80d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:09.791980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42efe0-0589-48dc-a493-5f6ff843c80d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:09.798159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f534a2-c8ab-434c-a356-685645d00ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:09.799037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f534a2-c8ab-434c-a356-685645d00ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:09.799444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f534a2-c8ab-434c-a356-685645d00ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:09.799699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f534a2-c8ab-434c-a356-685645d00ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:09.814841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f534a2-c8ab-434c-a356-685645d00ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:09.817099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f534a2-c8ab-434c-a356-685645d00ea5 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:09.829685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 673/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:14.009893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c52da-fc19-4068-bdf8-7d6afd49f67c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:14.010597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c52da-fc19-4068-bdf8-7d6afd49f67c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:14.010597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c52da-fc19-4068-bdf8-7d6afd49f67c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:14.011865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 674/1347] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:14.017316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae14d7-97c9-4316-a7f7-a49dff284323 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:14.017767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae14d7-97c9-4316-a7f7-a49dff284323 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:14.017867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae14d7-97c9-4316-a7f7-a49dff284323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:14.036364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f1ae14d7-97c9-4316-a7f7-a49dff284323 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:14.037570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f1ae14d7-97c9-4316-a7f7-a49dff284323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:14.046422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 674/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:14.083420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c52da-fc19-4068-bdf8-7d6afd49f67c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:14.085468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fa0c52da-fc19-4068-bdf8-7d6afd49f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:14.100989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c52da-fc19-4068-bdf8-7d6afd49f67c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:14.106258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af533983-e4e7-45bb-8142-87c4b2e7c608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:14.106906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533983-e4e7-45bb-8142-87c4b2e7c608 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:14.107191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533983-e4e7-45bb-8142-87c4b2e7c608 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:14.107462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533983-e4e7-45bb-8142-87c4b2e7c608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:14.116700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af533983-e4e7-45bb-8142-87c4b2e7c608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:14.118121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af533983-e4e7-45bb-8142-87c4b2e7c608 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:14.129920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 675/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:19.459379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbc158-283a-49e1-b8a6-f4db07c121ee None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:19.459943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbc158-283a-49e1-b8a6-f4db07c121ee None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:19.459943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbc158-283a-49e1-b8a6-f4db07c121ee None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:19.466339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 675/1350] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:21:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:19.478279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7e1a4-9124-4149-ad14-930943bcb4b4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:19.479483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7e1a4-9124-4149-ad14-930943bcb4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:19.483477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7e1a4-9124-4149-ad14-930943bcb4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:19.575503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-14f7e1a4-9124-4149-ad14-930943bcb4b4 None None] MFA Rules not processed for user `9edcf71253ee4c81a402fffe13128b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:19.576728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-14f7e1a4-9124-4149-ad14-930943bcb4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:19.652578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 676/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:21:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:24.030961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=13 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:24.201885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0079e7-1bbc-427d-b2ee-84cddae7ba91 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:24.202261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0079e7-1bbc-427d-b2ee-84cddae7ba91 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:24.202491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0079e7-1bbc-427d-b2ee-84cddae7ba91 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:24.204131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 676/1352] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:24.209151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f3682-936b-45d9-bc0b-043c762ecf42 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:24.209666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f3682-936b-45d9-bc0b-043c762ecf42 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:24.209762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f3682-936b-45d9-bc0b-043c762ecf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:24.232554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-431f3682-936b-45d9-bc0b-043c762ecf42 None None] MFA Rules not processed for user `9edcf71253ee4c81a402fffe13128b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:24.233813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-431f3682-936b-45d9-bc0b-043c762ecf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:24.243263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 677/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:21:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:25.741012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bae17-ddf4-4efe-aeb3-f96806f7e189 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:25.741618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bae17-ddf4-4efe-aeb3-f96806f7e189 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:25.741618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bae17-ddf4-4efe-aeb3-f96806f7e189 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:25.742938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 677/1354] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:25.748325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da217f4f-d856-4904-89ea-8f47d0c0bf36 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:25.748742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da217f4f-d856-4904-89ea-8f47d0c0bf36 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:25.748884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da217f4f-d856-4904-89ea-8f47d0c0bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:25.769109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-da217f4f-d856-4904-89ea-8f47d0c0bf36 None None] MFA Rules not processed for user `9edcf71253ee4c81a402fffe13128b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:25.770336 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da217f4f-d856-4904-89ea-8f47d0c0bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:25.779743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 678/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:21:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:29.440734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086caa7-b62e-476f-bdc7-5e83c0158e15 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:29.441353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086caa7-b62e-476f-bdc7-5e83c0158e15 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:29.441603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086caa7-b62e-476f-bdc7-5e83c0158e15 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:29.443021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 678/1356] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:29.448856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e78d0-f3a5-460c-beda-4390f98c480e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:29.449323 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e78d0-f3a5-460c-beda-4390f98c480e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:29.449413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e78d0-f3a5-460c-beda-4390f98c480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:29.469095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-575e78d0-f3a5-460c-beda-4390f98c480e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:29.470317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-575e78d0-f3a5-460c-beda-4390f98c480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:29.478818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 679/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:29.532176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7b46-76b2-4023-8327-26b8aa77700c None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:29.532662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7b46-76b2-4023-8327-26b8aa77700c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:29.533146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef7b46-76b2-4023-8327-26b8aa77700c None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:29.535044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 679/1358] 10.222.0.39 () {54 vars in 961 bytes} [Sat Jun 4 18:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:29.542622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5dc41-16ed-4647-bf75-5847a57215b8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:29.543090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5dc41-16ed-4647-bf75-5847a57215b8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:29.543546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5dc41-16ed-4647-bf75-5847a57215b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:29.590267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:29.600236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b4c5dc41-16ed-4647-bf75-5847a57215b8 None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:29.601462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b4c5dc41-16ed-4647-bf75-5847a57215b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:29.684860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 680/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Jun 4 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:29.692592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7b46-76b2-4023-8327-26b8aa77700c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:29.708643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef7b46-76b2-4023-8327-26b8aa77700c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:29.714523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf56f6e-aa23-418d-8cfb-8eed9772aaa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:29.715182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf56f6e-aa23-418d-8cfb-8eed9772aaa4 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:29.715464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf56f6e-aa23-418d-8cfb-8eed9772aaa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:29.715740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf56f6e-aa23-418d-8cfb-8eed9772aaa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:29.724506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf56f6e-aa23-418d-8cfb-8eed9772aaa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:29.726313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf56f6e-aa23-418d-8cfb-8eed9772aaa4 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:29.736096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 680/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:32.230258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92427586-52f2-4e0c-ad75-303912ee45c6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:32.230845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92427586-52f2-4e0c-ad75-303912ee45c6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:32.230845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92427586-52f2-4e0c-ad75-303912ee45c6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:32.232388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 681/1361] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:32.237633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683352ff-aae3-40ce-8f08-1ecd142e4a25 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:32.238092 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683352ff-aae3-40ce-8f08-1ecd142e4a25 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:32.238195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683352ff-aae3-40ce-8f08-1ecd142e4a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:32.257296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-683352ff-aae3-40ce-8f08-1ecd142e4a25 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:32.258877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-683352ff-aae3-40ce-8f08-1ecd142e4a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:32.268130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 681/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:32.313253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92427586-52f2-4e0c-ad75-303912ee45c6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:32.327634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92427586-52f2-4e0c-ad75-303912ee45c6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:32.333028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2ac4a-8d5e-4688-8fc1-a297affb7d54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:32.333734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2ac4a-8d5e-4688-8fc1-a297affb7d54 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:32.334083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2ac4a-8d5e-4688-8fc1-a297affb7d54 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:32.334425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2ac4a-8d5e-4688-8fc1-a297affb7d54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:32.343578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2ac4a-8d5e-4688-8fc1-a297affb7d54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:32.345187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2ac4a-8d5e-4688-8fc1-a297affb7d54 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:32.355003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 682/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:34.927909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7cbce-8562-40f1-9475-f33aa3152122 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:34.928473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7cbce-8562-40f1-9475-f33aa3152122 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:34.928473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7cbce-8562-40f1-9475-f33aa3152122 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:34.929869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 682/1364] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:34.935322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54c971-d892-421b-8cbc-abd1bfd40c09 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:34.935780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54c971-d892-421b-8cbc-abd1bfd40c09 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:34.935878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54c971-d892-421b-8cbc-abd1bfd40c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:34.954519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8d54c971-d892-421b-8cbc-abd1bfd40c09 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:34.955906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8d54c971-d892-421b-8cbc-abd1bfd40c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:34.964111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 683/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:35.012568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e181995-9521-477e-9d01-6d4183b8d214 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:35.013240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e181995-9521-477e-9d01-6d4183b8d214 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:35.013765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e181995-9521-477e-9d01-6d4183b8d214 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:35.015752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 683/1366] 10.222.0.39 () {54 vars in 961 bytes} [Sat Jun 4 18:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:35.021245 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bb750-cb1f-4786-94cc-b49225c689de None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:35.021533 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bb750-cb1f-4786-94cc-b49225c689de None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:35.021812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bb750-cb1f-4786-94cc-b49225c689de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:35.041176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fd3bb750-cb1f-4786-94cc-b49225c689de None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:35.042298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fd3bb750-cb1f-4786-94cc-b49225c689de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:35.051753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 684/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Jun 4 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:35.060036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e181995-9521-477e-9d01-6d4183b8d214 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:35.075616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e181995-9521-477e-9d01-6d4183b8d214 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:35.080983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9e332-db32-4266-88f1-bc851aae319e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:35.081731 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e332-db32-4266-88f1-bc851aae319e service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:35.082012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e332-db32-4266-88f1-bc851aae319e service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:35.082313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9e332-db32-4266-88f1-bc851aae319e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:35.092712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9e332-db32-4266-88f1-bc851aae319e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:35.094326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9e332-db32-4266-88f1-bc851aae319e service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:35.104061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 684/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:37.431988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2b9c-a4fd-496e-9f0f-53e39efa0f08 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:37.433188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2b9c-a4fd-496e-9f0f-53e39efa0f08 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:37.433475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2b9c-a4fd-496e-9f0f-53e39efa0f08 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:37.434916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 685/1369] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:37.441110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b067a81-7bf8-4c54-83c7-46ef99795498 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:37.441613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b067a81-7bf8-4c54-83c7-46ef99795498 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:37.441696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b067a81-7bf8-4c54-83c7-46ef99795498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:37.461235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1b067a81-7bf8-4c54-83c7-46ef99795498 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:37.462607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1b067a81-7bf8-4c54-83c7-46ef99795498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:37.471541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 685/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:37.515630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2b9c-a4fd-496e-9f0f-53e39efa0f08 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:37.531154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2b9c-a4fd-496e-9f0f-53e39efa0f08 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:37.536934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e8ff6-75b1-4bc3-8423-c5b6ed88b32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:37.537665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e8ff6-75b1-4bc3-8423-c5b6ed88b32e service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:37.538012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e8ff6-75b1-4bc3-8423-c5b6ed88b32e service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:37.538357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e8ff6-75b1-4bc3-8423-c5b6ed88b32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:37.547765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e8ff6-75b1-4bc3-8423-c5b6ed88b32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:37.549412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e8ff6-75b1-4bc3-8423-c5b6ed88b32e service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:37.562147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 686/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:37.746028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e9c7a-d883-481a-b059-5b99f1a5f328 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:37.746520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e9c7a-d883-481a-b059-5b99f1a5f328 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:37.746828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e9c7a-d883-481a-b059-5b99f1a5f328 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:37.748732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 686/1372] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:37.754781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0de92-db95-4061-aada-25eb8e8f7caf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:37.755128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0de92-db95-4061-aada-25eb8e8f7caf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:37.755338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0de92-db95-4061-aada-25eb8e8f7caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:37.774715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-73e0de92-db95-4061-aada-25eb8e8f7caf None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:37.776420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-73e0de92-db95-4061-aada-25eb8e8f7caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:37.785016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 687/1373] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:38.098607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d3c0-7911-4531-a1f7-e5ec8878691a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:38.099021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d3c0-7911-4531-a1f7-e5ec8878691a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:38.099428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d3c0-7911-4531-a1f7-e5ec8878691a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:38.101931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 687/1374] 10.222.0.39 () {54 vars in 963 bytes} [Sat Jun 4 18:21:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:38.107424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29753f29-e059-47d3-9da0-942e2ecee019 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:38.107827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29753f29-e059-47d3-9da0-942e2ecee019 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:38.108320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29753f29-e059-47d3-9da0-942e2ecee019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:38.162930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-29753f29-e059-47d3-9da0-942e2ecee019 None None] MFA Rules not processed for user `43023787db0749e8be546755f521755b`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:38.164362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-29753f29-e059-47d3-9da0-942e2ecee019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:38.227821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 688/1375] 10.222.0.39 () {58 vars in 1060 bytes} [Sat Jun 4 18:21:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:38.236296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d3c0-7911-4531-a1f7-e5ec8878691a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:38.247687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d3c0-7911-4531-a1f7-e5ec8878691a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:38.251425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a093d-1f6b-49d5-a7c5-c0cce050f81a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:38.252099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a093d-1f6b-49d5-a7c5-c0cce050f81a service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:38.252379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a093d-1f6b-49d5-a7c5-c0cce050f81a service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:38.252753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a093d-1f6b-49d5-a7c5-c0cce050f81a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:38.262520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a093d-1f6b-49d5-a7c5-c0cce050f81a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:38.264199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a093d-1f6b-49d5-a7c5-c0cce050f81a service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:38.274004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 688/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:39.886071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d432c-e529-406f-af46-5a7fb2c80569 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:39.886630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d432c-e529-406f-af46-5a7fb2c80569 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:39.886630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d432c-e529-406f-af46-5a7fb2c80569 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:39.887982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 689/1377] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:39.893640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950bb8c-2b7f-4748-a06c-fd268733d43b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:39.894107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950bb8c-2b7f-4748-a06c-fd268733d43b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:39.894277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950bb8c-2b7f-4748-a06c-fd268733d43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:39.913722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b950bb8c-2b7f-4748-a06c-fd268733d43b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:39.915305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b950bb8c-2b7f-4748-a06c-fd268733d43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:39.925192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 689/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:39.977451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d432c-e529-406f-af46-5a7fb2c80569 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:39.994160 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d432c-e529-406f-af46-5a7fb2c80569 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:40.000248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f4da2-6351-4253-89a5-0d2fb03b9e60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:40.000928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4da2-6351-4253-89a5-0d2fb03b9e60 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:40.001215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4da2-6351-4253-89a5-0d2fb03b9e60 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:40.001494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4da2-6351-4253-89a5-0d2fb03b9e60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:40.011119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f4da2-6351-4253-89a5-0d2fb03b9e60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:40.012797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f4da2-6351-4253-89a5-0d2fb03b9e60 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:40.017304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:40.024765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 690/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:42.343368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f0cf-f73c-427e-9e95-730692519448 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:42.343927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f0cf-f73c-427e-9e95-730692519448 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:42.343927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f0cf-f73c-427e-9e95-730692519448 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:42.349112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 690/1380] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:42.354352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f8fbe-a0b1-4902-88af-ae42c2b7d3ec None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:42.354867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f8fbe-a0b1-4902-88af-ae42c2b7d3ec None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:42.354867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f8fbe-a0b1-4902-88af-ae42c2b7d3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:42.374052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ba8f8fbe-a0b1-4902-88af-ae42c2b7d3ec None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:42.375254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ba8f8fbe-a0b1-4902-88af-ae42c2b7d3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:42.383749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 691/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:42.429149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f0cf-f73c-427e-9e95-730692519448 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:42.445342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f0cf-f73c-427e-9e95-730692519448 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:42.451597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c415730-8411-4255-812b-9721c8b1d3ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:42.452405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415730-8411-4255-812b-9721c8b1d3ca service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:42.452700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415730-8411-4255-812b-9721c8b1d3ca service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:42.452959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415730-8411-4255-812b-9721c8b1d3ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:42.462255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c415730-8411-4255-812b-9721c8b1d3ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:42.464151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c415730-8411-4255-812b-9721c8b1d3ca service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:42.474910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 691/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:44.754449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd96167-b5c6-459a-8d88-93f0558aeed1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:44.755021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd96167-b5c6-459a-8d88-93f0558aeed1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:44.755021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd96167-b5c6-459a-8d88-93f0558aeed1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:44.756407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 692/1383] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:44.762814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38ab1-dcab-463e-b853-efae1ca9324a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:44.763425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38ab1-dcab-463e-b853-efae1ca9324a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:44.763425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb38ab1-dcab-463e-b853-efae1ca9324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:44.784429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bdb38ab1-dcab-463e-b853-efae1ca9324a None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:44.785731 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bdb38ab1-dcab-463e-b853-efae1ca9324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:44.794941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 692/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:44.838592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd96167-b5c6-459a-8d88-93f0558aeed1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:44.853691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd96167-b5c6-459a-8d88-93f0558aeed1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:44.859607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6331a0-c30d-4673-9cd9-fb034488cf08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:44.860288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6331a0-c30d-4673-9cd9-fb034488cf08 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:44.860572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6331a0-c30d-4673-9cd9-fb034488cf08 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:44.860844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6331a0-c30d-4673-9cd9-fb034488cf08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:44.869686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6331a0-c30d-4673-9cd9-fb034488cf08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:44.871368 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6331a0-c30d-4673-9cd9-fb034488cf08 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:44.881354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 693/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:47.456932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b24223-05da-464f-9d87-57e12adb4f65 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:47.457659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b24223-05da-464f-9d87-57e12adb4f65 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:47.457659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b24223-05da-464f-9d87-57e12adb4f65 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:47.458982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 693/1386] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:47.465480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca530128-0d5b-4529-8ab9-64f1475b8302 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:47.465922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca530128-0d5b-4529-8ab9-64f1475b8302 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:47.466176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca530128-0d5b-4529-8ab9-64f1475b8302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:47.491297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ca530128-0d5b-4529-8ab9-64f1475b8302 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:47.493149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ca530128-0d5b-4529-8ab9-64f1475b8302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:47.507021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 694/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:21:47.553705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b24223-05da-464f-9d87-57e12adb4f65 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:47.573435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b24223-05da-464f-9d87-57e12adb4f65 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:47.578750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82694972-9d11-4f18-ba07-d57159b9a095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:47.579407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82694972-9d11-4f18-ba07-d57159b9a095 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:47.579693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82694972-9d11-4f18-ba07-d57159b9a095 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:47.579971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82694972-9d11-4f18-ba07-d57159b9a095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:47.589218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82694972-9d11-4f18-ba07-d57159b9a095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:47.591316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82694972-9d11-4f18-ba07-d57159b9a095 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:47.603757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 694/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:21:50.371691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c356-9336-4498-9ffa-d52c4a66da45 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:50.372252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c356-9336-4498-9ffa-d52c4a66da45 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:50.372557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c356-9336-4498-9ffa-d52c4a66da45 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:50.374713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 695/1389] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:50.381612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e3651-3292-4ee9-a8d3-d002c7ea78aa None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:50.382072 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e3651-3292-4ee9-a8d3-d002c7ea78aa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:50.382611 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e3651-3292-4ee9-a8d3-d002c7ea78aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:50.408894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a13e3651-3292-4ee9-a8d3-d002c7ea78aa None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:50.410382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a13e3651-3292-4ee9-a8d3-d002c7ea78aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:50.420776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 695/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:50.477121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0c356-9336-4498-9ffa-d52c4a66da45 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:50.493762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0c356-9336-4498-9ffa-d52c4a66da45 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:50.500035 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb3fa7-7f5b-4c06-813a-4639cb0b3a67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:50.500717 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb3fa7-7f5b-4c06-813a-4639cb0b3a67 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:50.501013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb3fa7-7f5b-4c06-813a-4639cb0b3a67 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:50.501329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb3fa7-7f5b-4c06-813a-4639cb0b3a67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:50.510711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb3fa7-7f5b-4c06-813a-4639cb0b3a67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:50.512756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb3fa7-7f5b-4c06-813a-4639cb0b3a67 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:50.522984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 696/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:53.170713 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820517b-b81e-40ce-9af5-9ff7f95d94c2 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:53.171375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820517b-b81e-40ce-9af5-9ff7f95d94c2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:53.171375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820517b-b81e-40ce-9af5-9ff7f95d94c2 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:53.172733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 696/1392] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:53.178453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db319-cab5-49ca-86e0-5481a6a39095 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:53.178928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db319-cab5-49ca-86e0-5481a6a39095 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:53.179031 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3db319-cab5-49ca-86e0-5481a6a39095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:53.197522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1a3db319-cab5-49ca-86e0-5481a6a39095 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:53.199016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a3db319-cab5-49ca-86e0-5481a6a39095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:53.207350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 697/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:53.251748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820517b-b81e-40ce-9af5-9ff7f95d94c2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:53.267500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820517b-b81e-40ce-9af5-9ff7f95d94c2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:53.273305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14a314-543e-434b-b133-be2c40f04d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:53.273948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14a314-543e-434b-b133-be2c40f04d00 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:53.274231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14a314-543e-434b-b133-be2c40f04d00 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:53.274508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14a314-543e-434b-b133-be2c40f04d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:53.283062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14a314-543e-434b-b133-be2c40f04d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:53.284689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14a314-543e-434b-b133-be2c40f04d00 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:53.295743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 697/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:54.083517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29f8c-b45e-4402-9b2b-4d67d7cb0716 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:54.083801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29f8c-b45e-4402-9b2b-4d67d7cb0716 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:54.084105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29f8c-b45e-4402-9b2b-4d67d7cb0716 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:54.085524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 698/1395] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:54.091334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e96fb6-8bd9-49c9-958d-d5e3bcb0d853 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:54.091693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e96fb6-8bd9-49c9-958d-d5e3bcb0d853 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:54.092036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e96fb6-8bd9-49c9-958d-d5e3bcb0d853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:54.098235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=52 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:54.112517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d5e96fb6-8bd9-49c9-958d-d5e3bcb0d853 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:54.113729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d5e96fb6-8bd9-49c9-958d-d5e3bcb0d853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:54.122022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 698/1396] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:21:54.178397 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda733a4-e80d-4cc3-a13f-c37cca6584c2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:54.178685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda733a4-e80d-4cc3-a13f-c37cca6584c2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:54.179262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda733a4-e80d-4cc3-a13f-c37cca6584c2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:54.180361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 699/1397] 10.222.0.39 () {54 vars in 962 bytes} [Sat Jun 4 18:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:54.185590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b476f-ed4a-4c10-b5bb-24e5993e2f5b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:54.186013 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b476f-ed4a-4c10-b5bb-24e5993e2f5b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:54.186141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b476f-ed4a-4c10-b5bb-24e5993e2f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:54.240349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2a6b476f-ed4a-4c10-b5bb-24e5993e2f5b None None] MFA Rules not processed for user `3b4adc107bf542b8bb0502c7fbf94431`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:54.241572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2a6b476f-ed4a-4c10-b5bb-24e5993e2f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:54.307485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 699/1398] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Jun 4 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:54.314953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda733a4-e80d-4cc3-a13f-c37cca6584c2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:54.326088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda733a4-e80d-4cc3-a13f-c37cca6584c2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:54.329883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38288-5c90-4d07-811f-418ceeaffcc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4adc107bf542b8bb0502c7fbf94431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:54.330534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38288-5c90-4d07-811f-418ceeaffcc7 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:54.330819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38288-5c90-4d07-811f-418ceeaffcc7 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:54.331087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38288-5c90-4d07-811f-418ceeaffcc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:54.340482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde38288-5c90-4d07-811f-418ceeaffcc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:54.341956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde38288-5c90-4d07-811f-418ceeaffcc7 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:54.351568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 700/1399] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:54.874800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ffda0-e4d6-4255-9a5f-6221fd177b54 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:54.875182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ffda0-e4d6-4255-9a5f-6221fd177b54 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:54.875451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ffda0-e4d6-4255-9a5f-6221fd177b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:54.923207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a67ffda0-e4d6-4255-9a5f-6221fd177b54 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:54.924423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a67ffda0-e4d6-4255-9a5f-6221fd177b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:54.987871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 700/1400] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:55.027871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f881-0bc7-4489-a730-18ab2d5f941a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:55.028326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f881-0bc7-4489-a730-18ab2d5f941a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:55.028666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f881-0bc7-4489-a730-18ab2d5f941a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:55.030152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 701/1401] 10.222.0.39 () {54 vars in 942 bytes} [Sat Jun 4 18:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:55.036729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704852-1812-4b08-91f2-ef3d7d0be774 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:55.037014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704852-1812-4b08-91f2-ef3d7d0be774 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:55.037293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da704852-1812-4b08-91f2-ef3d7d0be774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:55.086912 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-da704852-1812-4b08-91f2-ef3d7d0be774 None None] MFA Rules not processed for user `7a79a7fbb30b45cd8677d84dd1b5c008`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:55.088150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-da704852-1812-4b08-91f2-ef3d7d0be774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:55.101009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:21:55.160471 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 701/1402] 10.222.0.39 () {58 vars in 1039 bytes} [Sat Jun 4 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:21:55.170021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f881-0bc7-4489-a730-18ab2d5f941a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:55.184063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f881-0bc7-4489-a730-18ab2d5f941a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:55.189352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd89b3-cb62-461f-8965-85ae0652f5d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:55.189999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd89b3-cb62-461f-8965-85ae0652f5d0 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:55.190302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd89b3-cb62-461f-8965-85ae0652f5d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:55.190545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd89b3-cb62-461f-8965-85ae0652f5d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:55.199591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd89b3-cb62-461f-8965-85ae0652f5d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:55.201239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd89b3-cb62-461f-8965-85ae0652f5d0 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:55.209847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 702/1403] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:21:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 18:21:55.586455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68557aed-ad4a-404c-b749-1a97f3bc1edf None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:55.587031 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68557aed-ad4a-404c-b749-1a97f3bc1edf None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:55.587031 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68557aed-ad4a-404c-b749-1a97f3bc1edf None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:55.588737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 702/1404] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:55.594248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e8015-b849-4854-be70-efaf3ad04e39 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:55.594543 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e8015-b849-4854-be70-efaf3ad04e39 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:55.594824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e8015-b849-4854-be70-efaf3ad04e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:55.615221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-650e8015-b849-4854-be70-efaf3ad04e39 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:55.616471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-650e8015-b849-4854-be70-efaf3ad04e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:55.624768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 703/1405] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:55.670028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68557aed-ad4a-404c-b749-1a97f3bc1edf None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:55.684756 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68557aed-ad4a-404c-b749-1a97f3bc1edf None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:55.690288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94fe26-7831-4517-ad68-a7127a88270c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:55.691024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94fe26-7831-4517-ad68-a7127a88270c service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:55.691376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94fe26-7831-4517-ad68-a7127a88270c service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:55.691654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94fe26-7831-4517-ad68-a7127a88270c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:55.700692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94fe26-7831-4517-ad68-a7127a88270c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:55.702312 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94fe26-7831-4517-ad68-a7127a88270c service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:55.712261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 703/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:21:58.056199 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554344-2ed0-46e9-beb7-8ce6c5ba4491 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:58.056757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554344-2ed0-46e9-beb7-8ce6c5ba4491 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:58.056757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554344-2ed0-46e9-beb7-8ce6c5ba4491 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:58.058502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 704/1407] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:21:58.064124 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747dd21-a79f-48bc-9024-03d9e68cf8fb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:58.064754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747dd21-a79f-48bc-9024-03d9e68cf8fb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:58.064754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747dd21-a79f-48bc-9024-03d9e68cf8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:58.084382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0747dd21-a79f-48bc-9024-03d9e68cf8fb None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:21:58.085600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0747dd21-a79f-48bc-9024-03d9e68cf8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:21:58.096080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 704/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:21:58.139414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24554344-2ed0-46e9-beb7-8ce6c5ba4491 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:21:58.154760 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24554344-2ed0-46e9-beb7-8ce6c5ba4491 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:21:58.160457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b4d34-dbc5-4a14-ad71-834faa8cf91d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:21:58.161104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b4d34-dbc5-4a14-ad71-834faa8cf91d service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:21:58.161391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b4d34-dbc5-4a14-ad71-834faa8cf91d service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:21:58.161667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b4d34-dbc5-4a14-ad71-834faa8cf91d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:21:58.170616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b4d34-dbc5-4a14-ad71-834faa8cf91d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:21:58.173778 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b4d34-dbc5-4a14-ad71-834faa8cf91d service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:21:58.183411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 705/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:08.078838 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=33 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:22:08.178305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=43 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:22:18.526802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2463d5-fe06-4e5c-bead-7fd2f0cbdfd9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:18.527388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2463d5-fe06-4e5c-bead-7fd2f0cbdfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:18.527388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2463d5-fe06-4e5c-bead-7fd2f0cbdfd9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:18.528968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 705/1410] 10.222.0.39 () {54 vars in 918 bytes} [Sat Jun 4 18:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:18.536190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc83581-c7da-4cd7-8606-3d6ce0e240eb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:18.536685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc83581-c7da-4cd7-8606-3d6ce0e240eb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:18.536685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc83581-c7da-4cd7-8606-3d6ce0e240eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:18.563038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cfc83581-c7da-4cd7-8606-3d6ce0e240eb None None] MFA Rules not processed for user `9edcf71253ee4c81a402fffe13128b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:18.564203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cfc83581-c7da-4cd7-8606-3d6ce0e240eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:18.574603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 706/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Jun 4 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:18.589891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b83ca-e31e-4f77-8d60-463cc1eb8956 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:18.590179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b83ca-e31e-4f77-8d60-463cc1eb8956 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:18.590455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b83ca-e31e-4f77-8d60-463cc1eb8956 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:18.591842 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 706/1412] 10.222.0.39 () {54 vars in 918 bytes} [Sat Jun 4 18:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:18.596382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327dbf7-c386-483b-8e37-f9256d4dbfb4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:18.596673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327dbf7-c386-483b-8e37-f9256d4dbfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:18.596950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327dbf7-c386-483b-8e37-f9256d4dbfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:18.616367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6327dbf7-c386-483b-8e37-f9256d4dbfb4 None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:18.617563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6327dbf7-c386-483b-8e37-f9256d4dbfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:18.628713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 707/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Jun 4 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:21.411496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6643962-1f22-4e5e-93f9-19b5dc25d6dd None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:21.412408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6643962-1f22-4e5e-93f9-19b5dc25d6dd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:21.412408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6643962-1f22-4e5e-93f9-19b5dc25d6dd None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:21.414477 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:21.420882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150e95-9fc2-413c-841e-32f162e2f549 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:21.421348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150e95-9fc2-413c-841e-32f162e2f549 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:21.421452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0150e95-9fc2-413c-841e-32f162e2f549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:21.440864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d0150e95-9fc2-413c-841e-32f162e2f549 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:21.442054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d0150e95-9fc2-413c-841e-32f162e2f549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:21.450418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:21.495168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6643962-1f22-4e5e-93f9-19b5dc25d6dd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:21.512519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6643962-1f22-4e5e-93f9-19b5dc25d6dd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:21.518426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c122827-e42d-4890-ac0a-f5ff0e8e7188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:21.519074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122827-e42d-4890-ac0a-f5ff0e8e7188 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:21.519352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122827-e42d-4890-ac0a-f5ff0e8e7188 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:21.519626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122827-e42d-4890-ac0a-f5ff0e8e7188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:21.528566 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c122827-e42d-4890-ac0a-f5ff0e8e7188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:21.530198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c122827-e42d-4890-ac0a-f5ff0e8e7188 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:21.539926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 708/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:22.529919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993b06a-74e4-49e8-8910-4e8f154520aa None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:22.530770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993b06a-74e4-49e8-8910-4e8f154520aa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:22.530770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993b06a-74e4-49e8-8910-4e8f154520aa None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:22.533039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:22:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:22.538185 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce08d3-6c8f-47e5-8a69-e239f30db539 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:22.538630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce08d3-6c8f-47e5-8a69-e239f30db539 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:22.538732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce08d3-6c8f-47e5-8a69-e239f30db539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:22.563924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-43ce08d3-6c8f-47e5-8a69-e239f30db539 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:22.565620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-43ce08d3-6c8f-47e5-8a69-e239f30db539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:22.576523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:22.767013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993b06a-74e4-49e8-8910-4e8f154520aa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:22.786271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993b06a-74e4-49e8-8910-4e8f154520aa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:22.793721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ec923-2060-480f-8111-656745cf8a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:22.794367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ec923-2060-480f-8111-656745cf8a6b service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:22.794684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ec923-2060-480f-8111-656745cf8a6b service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:22.794956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ec923-2060-480f-8111-656745cf8a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:22.803821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ec923-2060-480f-8111-656745cf8a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:22.805468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ec923-2060-480f-8111-656745cf8a6b service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:22.815528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 710/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:23.746710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07bce7-1384-4122-a89d-f5d949b58fda None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:23.747582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07bce7-1384-4122-a89d-f5d949b58fda None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:23.747582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07bce7-1384-4122-a89d-f5d949b58fda None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:23.749826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:22:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:23.755066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e6fb0-b0a7-4c2d-9844-3b6f77944a95 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:23.755507 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e6fb0-b0a7-4c2d-9844-3b6f77944a95 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:23.755628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e6fb0-b0a7-4c2d-9844-3b6f77944a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:23.780046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8c0e6fb0-b0a7-4c2d-9844-3b6f77944a95 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:23.781238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8c0e6fb0-b0a7-4c2d-9844-3b6f77944a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:23.790001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:22:23.945647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07bce7-1384-4122-a89d-f5d949b58fda None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:23.962690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07bce7-1384-4122-a89d-f5d949b58fda None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:23.969146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db89df-dcb8-494a-be27-e9b36fa4438b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:23.969790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db89df-dcb8-494a-be27-e9b36fa4438b service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:23.970080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db89df-dcb8-494a-be27-e9b36fa4438b service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:23.970352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db89df-dcb8-494a-be27-e9b36fa4438b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:23.978793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db89df-dcb8-494a-be27-e9b36fa4438b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:23.980650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db89df-dcb8-494a-be27-e9b36fa4438b service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:23.990154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 711/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:24.905168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a777-58c8-4d3a-a73e-7efc36cf00bf None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:24.905764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a777-58c8-4d3a-a73e-7efc36cf00bf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:24.905764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a777-58c8-4d3a-a73e-7efc36cf00bf None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:24.907098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:24.913365 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf1ee-8b19-4dc0-853f-be4f39acae27 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:24.913811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf1ee-8b19-4dc0-853f-be4f39acae27 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:24.913925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf1ee-8b19-4dc0-853f-be4f39acae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:24.935130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-36bbf1ee-8b19-4dc0-853f-be4f39acae27 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:24.936345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-36bbf1ee-8b19-4dc0-853f-be4f39acae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:24.944963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:25.103414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a777-58c8-4d3a-a73e-7efc36cf00bf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:25.125002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a777-58c8-4d3a-a73e-7efc36cf00bf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:25.130861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b433d8f-230f-4229-8b87-687cff9f6e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:25.131507 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b433d8f-230f-4229-8b87-687cff9f6e09 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:25.131790 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b433d8f-230f-4229-8b87-687cff9f6e09 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:25.132095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b433d8f-230f-4229-8b87-687cff9f6e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:25.140901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b433d8f-230f-4229-8b87-687cff9f6e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:25.142508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b433d8f-230f-4229-8b87-687cff9f6e09 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:25.152704 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 713/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:26.055208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4b82-4796-4028-8ed0-f827bcff63f6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:26.056174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4b82-4796-4028-8ed0-f827bcff63f6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:26.056174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4b82-4796-4028-8ed0-f827bcff63f6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:26.058072 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:22:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:26.064239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58730f1f-9814-4eec-aff1-70b348d85be9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:26.064686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58730f1f-9814-4eec-aff1-70b348d85be9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:26.064842 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58730f1f-9814-4eec-aff1-70b348d85be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:26.091813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-58730f1f-9814-4eec-aff1-70b348d85be9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:26.093081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-58730f1f-9814-4eec-aff1-70b348d85be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:26.101693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:26.253657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e4b82-4796-4028-8ed0-f827bcff63f6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:26.273758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e4b82-4796-4028-8ed0-f827bcff63f6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:26.280698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae80546-61a2-4ee7-8794-aef3ea459897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:26.281348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80546-61a2-4ee7-8794-aef3ea459897 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:26.281634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80546-61a2-4ee7-8794-aef3ea459897 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:26.281913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80546-61a2-4ee7-8794-aef3ea459897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:26.291292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae80546-61a2-4ee7-8794-aef3ea459897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:26.293045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae80546-61a2-4ee7-8794-aef3ea459897 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:26.303212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 714/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:27.156834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7dc99-8f41-4314-80bc-ef2c717d3d99 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:27.157420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7dc99-8f41-4314-80bc-ef2c717d3d99 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:27.157420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7dc99-8f41-4314-80bc-ef2c717d3d99 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:27.158675 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:27.164982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d9b1a-8f2a-43e5-8d18-86d1c83423da None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:27.166044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d9b1a-8f2a-43e5-8d18-86d1c83423da None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:27.166221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d9b1a-8f2a-43e5-8d18-86d1c83423da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:27.186037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-962d9b1a-8f2a-43e5-8d18-86d1c83423da None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:27.187261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-962d9b1a-8f2a-43e5-8d18-86d1c83423da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:27.196671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:27.349871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7dc99-8f41-4314-80bc-ef2c717d3d99 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:27.373730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7dc99-8f41-4314-80bc-ef2c717d3d99 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:27.380281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ad472-5f41-4589-ad36-ecf17fbdc9a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:27.380933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ad472-5f41-4589-ad36-ecf17fbdc9a1 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:27.381214 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ad472-5f41-4589-ad36-ecf17fbdc9a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:27.381486 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ad472-5f41-4589-ad36-ecf17fbdc9a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:27.390639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ad472-5f41-4589-ad36-ecf17fbdc9a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:27.392264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ad472-5f41-4589-ad36-ecf17fbdc9a1 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:27.403148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 716/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:28.256567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf14ee-954b-44f2-b54e-23c4bde86c83 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:28.257144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf14ee-954b-44f2-b54e-23c4bde86c83 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:28.257144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf14ee-954b-44f2-b54e-23c4bde86c83 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:28.258514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:28.264995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69682711-563a-41dd-a1a2-e6c4f3828c42 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:28.265750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69682711-563a-41dd-a1a2-e6c4f3828c42 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:28.265957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69682711-563a-41dd-a1a2-e6c4f3828c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:28.289687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-69682711-563a-41dd-a1a2-e6c4f3828c42 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:28.291237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-69682711-563a-41dd-a1a2-e6c4f3828c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:28.300043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:28.450709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf14ee-954b-44f2-b54e-23c4bde86c83 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:28.465700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf14ee-954b-44f2-b54e-23c4bde86c83 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:28.471382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022b335-a427-4de1-b8ae-dab6e2081670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:28.472037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022b335-a427-4de1-b8ae-dab6e2081670 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:28.472320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022b335-a427-4de1-b8ae-dab6e2081670 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:28.472591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022b335-a427-4de1-b8ae-dab6e2081670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:28.480635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022b335-a427-4de1-b8ae-dab6e2081670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:28.482233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022b335-a427-4de1-b8ae-dab6e2081670 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:28.491585 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 717/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:29.348964 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cfefa-fd68-4e72-ab4f-24cdbe0c5b3a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:29.349460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cfefa-fd68-4e72-ab4f-24cdbe0c5b3a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:29.349460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cfefa-fd68-4e72-ab4f-24cdbe0c5b3a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:29.351548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:22:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:29.358207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ffd8-fc98-4c85-a46a-200613c2c431 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:29.358620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ffd8-fc98-4c85-a46a-200613c2c431 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:29.358752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514ffd8-fc98-4c85-a46a-200613c2c431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:29.380220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4514ffd8-fc98-4c85-a46a-200613c2c431 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:29.381469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4514ffd8-fc98-4c85-a46a-200613c2c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:29.390551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:29.541092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cfefa-fd68-4e72-ab4f-24cdbe0c5b3a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:29.564223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cfefa-fd68-4e72-ab4f-24cdbe0c5b3a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:29.570753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3dde4-8bcb-455e-92ef-1b90b27c71d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:29.571415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3dde4-8bcb-455e-92ef-1b90b27c71d6 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:29.571695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3dde4-8bcb-455e-92ef-1b90b27c71d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:29.571989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3dde4-8bcb-455e-92ef-1b90b27c71d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:29.580621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3dde4-8bcb-455e-92ef-1b90b27c71d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:29.582211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3dde4-8bcb-455e-92ef-1b90b27c71d6 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:29.591823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 719/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:30.455449 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de12d0-6d0c-4221-a5b7-b441b6e70964 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:30.456319 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de12d0-6d0c-4221-a5b7-b441b6e70964 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:30.456411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de12d0-6d0c-4221-a5b7-b441b6e70964 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:30.458605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:22:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:30.466786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787c579-9ffa-4486-a11c-ef110d23c21b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:30.467248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787c579-9ffa-4486-a11c-ef110d23c21b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:30.467343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787c579-9ffa-4486-a11c-ef110d23c21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:30.496309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6787c579-9ffa-4486-a11c-ef110d23c21b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:30.497508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6787c579-9ffa-4486-a11c-ef110d23c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:30.506318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:30.656801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de12d0-6d0c-4221-a5b7-b441b6e70964 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:30.675091 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de12d0-6d0c-4221-a5b7-b441b6e70964 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:30.681041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a48872-ace2-45e3-b7f2-cd5f23476bc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:30.681675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a48872-ace2-45e3-b7f2-cd5f23476bc3 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:30.681946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a48872-ace2-45e3-b7f2-cd5f23476bc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:30.682222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a48872-ace2-45e3-b7f2-cd5f23476bc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:30.690539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a48872-ace2-45e3-b7f2-cd5f23476bc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:30.692166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a48872-ace2-45e3-b7f2-cd5f23476bc3 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:30.702036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 720/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:32.807484 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37103009-5f64-4467-8896-f9984c86da79 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:32.808746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37103009-5f64-4467-8896-f9984c86da79 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:32.808746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37103009-5f64-4467-8896-f9984c86da79 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:32.809938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:32.815468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c3e23-0236-447a-9156-7200bf2faf68 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:32.815889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c3e23-0236-447a-9156-7200bf2faf68 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:32.816022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c3e23-0236-447a-9156-7200bf2faf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:32.834649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6e5c3e23-0236-447a-9156-7200bf2faf68 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:32.835833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6e5c3e23-0236-447a-9156-7200bf2faf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:32.844224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:32.885232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37103009-5f64-4467-8896-f9984c86da79 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:32.898605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37103009-5f64-4467-8896-f9984c86da79 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:32.902646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8bcc2-610d-41c9-8994-23505e3176f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:32.903286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8bcc2-610d-41c9-8994-23505e3176f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:32.903566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8bcc2-610d-41c9-8994-23505e3176f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:32.903867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8bcc2-610d-41c9-8994-23505e3176f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:32.913825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8bcc2-610d-41c9-8994-23505e3176f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:32.915262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8bcc2-610d-41c9-8994-23505e3176f6 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:32.925181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 722/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:35.354423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba320c-a048-4bcd-bbdc-594a7264d709 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:35.355271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba320c-a048-4bcd-bbdc-594a7264d709 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:35.355567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba320c-a048-4bcd-bbdc-594a7264d709 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:35.356995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:35.362967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2f83-8b60-4fcb-bec9-b412cccd2415 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:35.363651 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2f83-8b60-4fcb-bec9-b412cccd2415 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:35.363761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2f83-8b60-4fcb-bec9-b412cccd2415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:35.390805 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-45fc2f83-8b60-4fcb-bec9-b412cccd2415 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:35.392042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-45fc2f83-8b60-4fcb-bec9-b412cccd2415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:35.401450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:35.440446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba320c-a048-4bcd-bbdc-594a7264d709 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:35.455357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba320c-a048-4bcd-bbdc-594a7264d709 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:35.459284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1f169-3826-4706-9e5a-ca89c813de03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:35.459863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f169-3826-4706-9e5a-ca89c813de03 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:35.460177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f169-3826-4706-9e5a-ca89c813de03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:35.460457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1f169-3826-4706-9e5a-ca89c813de03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:35.469588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1f169-3826-4706-9e5a-ca89c813de03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:35.471041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1f169-3826-4706-9e5a-ca89c813de03 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:35.480809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 723/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:38.040027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268a16-5200-4858-a306-0fd84a5bf898 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:38.040707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268a16-5200-4858-a306-0fd84a5bf898 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:38.040707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268a16-5200-4858-a306-0fd84a5bf898 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:38.042489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:38.048152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073fc35-741f-4722-88ee-632a49a01082 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:38.048633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073fc35-741f-4722-88ee-632a49a01082 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:38.048738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073fc35-741f-4722-88ee-632a49a01082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:38.067291 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5073fc35-741f-4722-88ee-632a49a01082 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:38.068523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5073fc35-741f-4722-88ee-632a49a01082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:38.077035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:38.126299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb268a16-5200-4858-a306-0fd84a5bf898 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:38.138111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb268a16-5200-4858-a306-0fd84a5bf898 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:38.141877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f7735-71aa-44db-aa09-7b8fbd006ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:38.142507 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7735-71aa-44db-aa09-7b8fbd006ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:38.142789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7735-71aa-44db-aa09-7b8fbd006ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:38.143062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7735-71aa-44db-aa09-7b8fbd006ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:38.152334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f7735-71aa-44db-aa09-7b8fbd006ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:38.153771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f7735-71aa-44db-aa09-7b8fbd006ce0 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:38.163595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 725/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:22:40.533748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad560170-7080-45ec-bee2-ac03e5c3676b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:40.534348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad560170-7080-45ec-bee2-ac03e5c3676b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:40.534348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad560170-7080-45ec-bee2-ac03e5c3676b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:40.535714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:40.542563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9e128-d84f-4911-8441-1adcf4c7bee7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:40.543039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9e128-d84f-4911-8441-1adcf4c7bee7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:40.543154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9e128-d84f-4911-8441-1adcf4c7bee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:40.568693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8aa9e128-d84f-4911-8441-1adcf4c7bee7 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:40.569818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8aa9e128-d84f-4911-8441-1adcf4c7bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:40.578408 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:40.621026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad560170-7080-45ec-bee2-ac03e5c3676b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:40.639040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad560170-7080-45ec-bee2-ac03e5c3676b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:40.643351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dd4d2-381f-46ff-872c-bd0c602055bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:40.643988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dd4d2-381f-46ff-872c-bd0c602055bf service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:40.644299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dd4d2-381f-46ff-872c-bd0c602055bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:40.644571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dd4d2-381f-46ff-872c-bd0c602055bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:40.654738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dd4d2-381f-46ff-872c-bd0c602055bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:40.656333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dd4d2-381f-46ff-872c-bd0c602055bf service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:40.666504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 726/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:42.966229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce5afc-d37b-4c8e-a6ca-c2cfd2a6acca None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:42.966853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce5afc-d37b-4c8e-a6ca-c2cfd2a6acca None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:42.966853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce5afc-d37b-4c8e-a6ca-c2cfd2a6acca None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:42.968165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:22:42.974786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511d1e1-c124-4b24-808e-dc052bd30bec None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:42.975544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511d1e1-c124-4b24-808e-dc052bd30bec None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:42.975544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511d1e1-c124-4b24-808e-dc052bd30bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:43.002583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0511d1e1-c124-4b24-808e-dc052bd30bec None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:43.003838 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0511d1e1-c124-4b24-808e-dc052bd30bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:43.013954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:43.052438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce5afc-d37b-4c8e-a6ca-c2cfd2a6acca None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:43.066151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce5afc-d37b-4c8e-a6ca-c2cfd2a6acca None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:43.070512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f647509-d202-4b6f-9d6f-df914f70eca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:43.071134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f647509-d202-4b6f-9d6f-df914f70eca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:43.071409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f647509-d202-4b6f-9d6f-df914f70eca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:43.071678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f647509-d202-4b6f-9d6f-df914f70eca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:43.081095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f647509-d202-4b6f-9d6f-df914f70eca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:43.082536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f647509-d202-4b6f-9d6f-df914f70eca4 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:43.091803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 728/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:45.405438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b9ff0-772d-4409-9cb7-328fda4b5e8c None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:45.406058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b9ff0-772d-4409-9cb7-328fda4b5e8c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:45.406058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b9ff0-772d-4409-9cb7-328fda4b5e8c None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:45.407416 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:45.413279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a25c8-8c60-48db-abb5-54f8f5aff8f4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:45.413735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a25c8-8c60-48db-abb5-54f8f5aff8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:45.413830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a25c8-8c60-48db-abb5-54f8f5aff8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:45.433602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-df7a25c8-8c60-48db-abb5-54f8f5aff8f4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:45.434778 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-df7a25c8-8c60-48db-abb5-54f8f5aff8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:45.443050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:22:45.484348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b9ff0-772d-4409-9cb7-328fda4b5e8c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:45.497821 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b9ff0-772d-4409-9cb7-328fda4b5e8c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:45.502730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88627f4-3374-4f8b-84a7-6ae0c802fb9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:45.503380 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88627f4-3374-4f8b-84a7-6ae0c802fb9e service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:45.503663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88627f4-3374-4f8b-84a7-6ae0c802fb9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:45.503939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88627f4-3374-4f8b-84a7-6ae0c802fb9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:45.513813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88627f4-3374-4f8b-84a7-6ae0c802fb9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:45.515266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88627f4-3374-4f8b-84a7-6ae0c802fb9e service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:45.524680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 729/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:47.817462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6dcd-f7e5-48cc-a46a-db3dede824c3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:47.818082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6dcd-f7e5-48cc-a46a-db3dede824c3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:47.818082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6dcd-f7e5-48cc-a46a-db3dede824c3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:47.819387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:47.825606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91180d8f-8f4e-4329-88b3-2af4f94b9289 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:47.826060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91180d8f-8f4e-4329-88b3-2af4f94b9289 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:47.826156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91180d8f-8f4e-4329-88b3-2af4f94b9289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:47.853962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-91180d8f-8f4e-4329-88b3-2af4f94b9289 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:47.855398 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-91180d8f-8f4e-4329-88b3-2af4f94b9289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:47.864485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:47.909747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e6dcd-f7e5-48cc-a46a-db3dede824c3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:47.925111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e6dcd-f7e5-48cc-a46a-db3dede824c3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:47.929289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641dd01-8701-4bd3-88f4-3ce59114329e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:47.929932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641dd01-8701-4bd3-88f4-3ce59114329e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:47.930215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641dd01-8701-4bd3-88f4-3ce59114329e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:47.930492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641dd01-8701-4bd3-88f4-3ce59114329e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:47.939743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641dd01-8701-4bd3-88f4-3ce59114329e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:47.941186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641dd01-8701-4bd3-88f4-3ce59114329e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:47.950797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 731/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:50.223242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603c020-201a-4bfa-b023-4e1ef45b4248 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:50.224213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603c020-201a-4bfa-b023-4e1ef45b4248 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:50.224213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603c020-201a-4bfa-b023-4e1ef45b4248 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:50.226349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:50.232689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e2ca-33d3-4fee-9e8c-fd04b526138a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:50.233189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e2ca-33d3-4fee-9e8c-fd04b526138a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:50.233308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263e2ca-33d3-4fee-9e8c-fd04b526138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:50.242364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=79 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:22:50.256939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1263e2ca-33d3-4fee-9e8c-fd04b526138a None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:50.258142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1263e2ca-33d3-4fee-9e8c-fd04b526138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:50.267068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:50.305282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603c020-201a-4bfa-b023-4e1ef45b4248 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:50.313619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=73 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:22:50.323502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603c020-201a-4bfa-b023-4e1ef45b4248 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:50.328316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8e09a-5e72-4847-89e4-2fd81db066e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:50.328973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8e09a-5e72-4847-89e4-2fd81db066e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:50.329259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8e09a-5e72-4847-89e4-2fd81db066e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:50.329533 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8e09a-5e72-4847-89e4-2fd81db066e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:50.339801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8e09a-5e72-4847-89e4-2fd81db066e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:50.341300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8e09a-5e72-4847-89e4-2fd81db066e2 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:50.351206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 732/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:52.612665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8edfc-e099-4ec6-b6ed-1913bf3adb1e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:52.613218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8edfc-e099-4ec6-b6ed-1913bf3adb1e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:52.613218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8edfc-e099-4ec6-b6ed-1913bf3adb1e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:52.614491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:52.620116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfafc5-c1ad-4515-a1f9-f94ffb8de27f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:52.621004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfafc5-c1ad-4515-a1f9-f94ffb8de27f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:52.621004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfafc5-c1ad-4515-a1f9-f94ffb8de27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:52.640443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-17cfafc5-c1ad-4515-a1f9-f94ffb8de27f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:52.641632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-17cfafc5-c1ad-4515-a1f9-f94ffb8de27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:52.650853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:52.687649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8edfc-e099-4ec6-b6ed-1913bf3adb1e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:52.700586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8edfc-e099-4ec6-b6ed-1913bf3adb1e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:52.704937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ccbc4-3d11-425c-aac5-3eee75202d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:52.705577 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ccbc4-3d11-425c-aac5-3eee75202d8e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:52.705859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ccbc4-3d11-425c-aac5-3eee75202d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:52.706133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ccbc4-3d11-425c-aac5-3eee75202d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:52.715303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ccbc4-3d11-425c-aac5-3eee75202d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:52.716781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ccbc4-3d11-425c-aac5-3eee75202d8e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:52.726064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 734/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:22:54.962531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eb609-ee47-40b7-bd29-3b803c430af1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:54.963410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eb609-ee47-40b7-bd29-3b803c430af1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:54.963410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eb609-ee47-40b7-bd29-3b803c430af1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:54.965350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:22:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:22:54.971792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee6013-859a-4601-a052-a641e10c680e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:54.972588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee6013-859a-4601-a052-a641e10c680e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:54.972742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee6013-859a-4601-a052-a641e10c680e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:55.005200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-50ee6013-859a-4601-a052-a641e10c680e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:22:55.006917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-50ee6013-859a-4601-a052-a641e10c680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:22:55.021368 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:22:55.059879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eb609-ee47-40b7-bd29-3b803c430af1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:22:55.072589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eb609-ee47-40b7-bd29-3b803c430af1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:22:55.077121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abceac-04e9-49f4-abc2-c497ec358abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:22:55.077790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abceac-04e9-49f4-abc2-c497ec358abd service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:22:55.078222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abceac-04e9-49f4-abc2-c497ec358abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:22:55.078501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abceac-04e9-49f4-abc2-c497ec358abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:22:55.088957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abceac-04e9-49f4-abc2-c497ec358abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:22:55.090451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abceac-04e9-49f4-abc2-c497ec358abd service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:22:55.100412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 735/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:23:04.997046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=11 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:23:05.095767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=14 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:23:26.962956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ce7cf-4872-43e4-bdd0-0dc4af5a3035 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:26.963590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ce7cf-4872-43e4-bdd0-0dc4af5a3035 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:26.963590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ce7cf-4872-43e4-bdd0-0dc4af5a3035 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:26.965609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 736/1471] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:23:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:23:26.974810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858b748-ece2-42a7-8710-11d24cd0e316 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:26.975255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858b748-ece2-42a7-8710-11d24cd0e316 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:26.975555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858b748-ece2-42a7-8710-11d24cd0e316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:26.996365 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0858b748-ece2-42a7-8710-11d24cd0e316 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:23:26.997588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0858b748-ece2-42a7-8710-11d24cd0e316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:23:27.006729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 736/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:23:27.056583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc556933-3b91-4e65-a908-20f5b5f6402d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:27.056871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc556933-3b91-4e65-a908-20f5b5f6402d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:27.057146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc556933-3b91-4e65-a908-20f5b5f6402d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:27.058871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 737/1473] 10.222.0.39 () {54 vars in 962 bytes} [Sat Jun 4 18:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:23:27.064702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09e402-1c6a-47fa-8074-8a6b178271f9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:27.065073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09e402-1c6a-47fa-8074-8a6b178271f9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:27.065451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09e402-1c6a-47fa-8074-8a6b178271f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:27.087729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bc09e402-1c6a-47fa-8074-8a6b178271f9 None None] MFA Rules not processed for user `3b4adc107bf542b8bb0502c7fbf94431`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:23:27.089005 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bc09e402-1c6a-47fa-8074-8a6b178271f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:23:27.096749 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 737/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Jun 4 18:23:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:23:27.104033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc556933-3b91-4e65-a908-20f5b5f6402d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:23:27.116750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc556933-3b91-4e65-a908-20f5b5f6402d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:23:27.120739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268d4fe-3531-4bf1-8597-2c9fb84bbf08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4adc107bf542b8bb0502c7fbf94431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:23:27.121653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d4fe-3531-4bf1-8597-2c9fb84bbf08 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:27.121937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d4fe-3531-4bf1-8597-2c9fb84bbf08 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:27.122207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d4fe-3531-4bf1-8597-2c9fb84bbf08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:27.131784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268d4fe-3531-4bf1-8597-2c9fb84bbf08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:23:27.133240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268d4fe-3531-4bf1-8597-2c9fb84bbf08 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:23:27.142990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 738/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:23:29.483645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a64a0-755a-4d93-bde2-de28b415bdac None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:29.484281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a64a0-755a-4d93-bde2-de28b415bdac None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:29.484281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a64a0-755a-4d93-bde2-de28b415bdac None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:29.485590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 738/1476] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:23:29.493943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e1a23-9019-49d3-9b41-2b6f4a3cc8b4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:29.494618 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e1a23-9019-49d3-9b41-2b6f4a3cc8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:29.494733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e1a23-9019-49d3-9b41-2b6f4a3cc8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:29.513764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a67e1a23-9019-49d3-9b41-2b6f4a3cc8b4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:23:29.514990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a67e1a23-9019-49d3-9b41-2b6f4a3cc8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:23:29.523500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 739/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:23:29.548303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a64a0-755a-4d93-bde2-de28b415bdac None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:23:29.567650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a64a0-755a-4d93-bde2-de28b415bdac None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:23:29.575790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7d0f5-e31e-4034-a810-4c7330c54f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:23:29.576757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7d0f5-e31e-4034-a810-4c7330c54f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:29.577117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7d0f5-e31e-4034-a810-4c7330c54f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:29.577428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7d0f5-e31e-4034-a810-4c7330c54f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:29.578553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7d0f5-e31e-4034-a810-4c7330c54f10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:23:29.581282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-46d7d0f5-e31e-4034-a810-4c7330c54f10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:23:29.581282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 04 18:23:29.581282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: Jun 04 18:23:29.582901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7d0f5-e31e-4034-a810-4c7330c54f10 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:23:29.604669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 739/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Jun 4 18:23:29 2022] GET /identity/v3/projects => generated 2553 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:23:31.855957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc01d-1072-4111-8f01-726ade9ace58 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:31.856588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc01d-1072-4111-8f01-726ade9ace58 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:31.856588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafc01d-1072-4111-8f01-726ade9ace58 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:31.857958 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 740/1479] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:23:31.864527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596a6f-89ab-418e-9bfe-8107b9004644 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:31.865251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596a6f-89ab-418e-9bfe-8107b9004644 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:31.865419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596a6f-89ab-418e-9bfe-8107b9004644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:31.892529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ea596a6f-89ab-418e-9bfe-8107b9004644 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:23:31.894151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ea596a6f-89ab-418e-9bfe-8107b9004644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:23:31.906108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 740/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:23:31.954545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc01d-1072-4111-8f01-726ade9ace58 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:23:31.973705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafc01d-1072-4111-8f01-726ade9ace58 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:23:31.979830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e883c80-f7b3-40b7-8670-d4c5969b9b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:23:31.980186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883c80-f7b3-40b7-8670-d4c5969b9b87 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:31.980469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883c80-f7b3-40b7-8670-d4c5969b9b87 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:31.980741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e883c80-f7b3-40b7-8670-d4c5969b9b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:31.989629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e883c80-f7b3-40b7-8670-d4c5969b9b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:23:31.991240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e883c80-f7b3-40b7-8670-d4c5969b9b87 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:23:32.001833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 741/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:23:34.422895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5000f4-a95b-486c-98d0-9f2e02340b80 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:34.423432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5000f4-a95b-486c-98d0-9f2e02340b80 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:34.423611 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5000f4-a95b-486c-98d0-9f2e02340b80 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:34.425859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 741/1482] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:23:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:23:34.433897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567db433-6631-426d-aeec-7a919c531085 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:34.434362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567db433-6631-426d-aeec-7a919c531085 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:34.434474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567db433-6631-426d-aeec-7a919c531085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:34.458053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-567db433-6631-426d-aeec-7a919c531085 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:23:34.459867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-567db433-6631-426d-aeec-7a919c531085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:23:34.474484 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 742/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:23:34.514918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5000f4-a95b-486c-98d0-9f2e02340b80 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:23:34.528733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5000f4-a95b-486c-98d0-9f2e02340b80 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:23:34.533212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b47c28-0e5f-4cf8-b0be-bbc2ca3d8d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:23:34.533858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b47c28-0e5f-4cf8-b0be-bbc2ca3d8d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:34.534136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b47c28-0e5f-4cf8-b0be-bbc2ca3d8d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:34.534417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b47c28-0e5f-4cf8-b0be-bbc2ca3d8d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:34.545293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b47c28-0e5f-4cf8-b0be-bbc2ca3d8d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:23:34.546755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b47c28-0e5f-4cf8-b0be-bbc2ca3d8d18 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:23:34.556942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 742/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:23:36.838922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457d329-79a0-4be9-bc47-1db2a9f6a35a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:36.840099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457d329-79a0-4be9-bc47-1db2a9f6a35a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:36.840099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457d329-79a0-4be9-bc47-1db2a9f6a35a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:36.840925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 743/1485] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:23:36.847325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f941-13fa-47f1-b9c7-3969fbee5781 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:36.848096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f941-13fa-47f1-b9c7-3969fbee5781 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:36.848320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f941-13fa-47f1-b9c7-3969fbee5781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:36.870925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7a26f941-13fa-47f1-b9c7-3969fbee5781 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:23:36.872181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7a26f941-13fa-47f1-b9c7-3969fbee5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:23:36.881507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 743/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:23:36.920618 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457d329-79a0-4be9-bc47-1db2a9f6a35a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:23:36.935573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457d329-79a0-4be9-bc47-1db2a9f6a35a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:23:36.939506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9fab0-252f-4aba-96f8-6c79270de2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:23:36.940176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9fab0-252f-4aba-96f8-6c79270de2ac service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:36.940467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9fab0-252f-4aba-96f8-6c79270de2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:36.940748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9fab0-252f-4aba-96f8-6c79270de2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:36.950004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9fab0-252f-4aba-96f8-6c79270de2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:23:36.951453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9fab0-252f-4aba-96f8-6c79270de2ac service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:23:36.960940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 744/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:23:39.349899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467be43f-d22a-42a0-95d2-bf8745b6bd91 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:39.350904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467be43f-d22a-42a0-95d2-bf8745b6bd91 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:39.350904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467be43f-d22a-42a0-95d2-bf8745b6bd91 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:39.353093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 744/1488] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:23:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:23:39.362644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb88de0-ecad-41ef-87d9-87c124e9225f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:39.363255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb88de0-ecad-41ef-87d9-87c124e9225f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:39.363449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb88de0-ecad-41ef-87d9-87c124e9225f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:39.393151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ebb88de0-ecad-41ef-87d9-87c124e9225f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:23:39.394372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ebb88de0-ecad-41ef-87d9-87c124e9225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:23:39.403894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 745/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:23:39.457838 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467be43f-d22a-42a0-95d2-bf8745b6bd91 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:23:39.472379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467be43f-d22a-42a0-95d2-bf8745b6bd91 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:23:39.476351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51543b70-780a-46d1-9a84-b1fa60a57b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:23:39.476997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543b70-780a-46d1-9a84-b1fa60a57b36 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:39.477281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543b70-780a-46d1-9a84-b1fa60a57b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:39.477560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543b70-780a-46d1-9a84-b1fa60a57b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:39.487014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51543b70-780a-46d1-9a84-b1fa60a57b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:23:39.488508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51543b70-780a-46d1-9a84-b1fa60a57b36 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:23:39.498420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 745/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:23:41.994464 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222cf49-df94-47dc-bda3-03ab163849fc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:41.995033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222cf49-df94-47dc-bda3-03ab163849fc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:41.995033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222cf49-df94-47dc-bda3-03ab163849fc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:41.997944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 746/1491] 10.222.0.39 () {54 vars in 926 bytes} [Sat Jun 4 18:23:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:23:42.006835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72240e5a-cf6e-46d1-91fc-87dc639504c0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:42.007274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72240e5a-cf6e-46d1-91fc-87dc639504c0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:42.007590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72240e5a-cf6e-46d1-91fc-87dc639504c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:42.027998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-72240e5a-cf6e-46d1-91fc-87dc639504c0 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:23:42.029258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-72240e5a-cf6e-46d1-91fc-87dc639504c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:23:42.038242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 746/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Sat Jun 4 18:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:23:42.077783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222cf49-df94-47dc-bda3-03ab163849fc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:23:42.095816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222cf49-df94-47dc-bda3-03ab163849fc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:23:42.102440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a8cf6-bf91-4792-91e3-810a2fcfe3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:23:42.103400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a8cf6-bf91-4792-91e3-810a2fcfe3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:23:42.103805 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a8cf6-bf91-4792-91e3-810a2fcfe3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:23:42.104272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a8cf6-bf91-4792-91e3-810a2fcfe3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:23:42.115435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a8cf6-bf91-4792-91e3-810a2fcfe3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:23:42.116944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a8cf6-bf91-4792-91e3-810a2fcfe3f8 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:23:42.126982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 747/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:23:52.022300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=33 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:23:52.122352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=33 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:25:08.670088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb046a74-dbc7-4f0c-ba3e-da63f026c426 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:08.670908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb046a74-dbc7-4f0c-ba3e-da63f026c426 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:08.670908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb046a74-dbc7-4f0c-ba3e-da63f026c426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:08.700790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-cb046a74-dbc7-4f0c-ba3e-da63f026c426 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:25:08.702012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cb046a74-dbc7-4f0c-ba3e-da63f026c426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:25:08.711326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 747/1494] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:25:08.722933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbd897-ef24-4981-81ee-66a02f9ca316 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:08.723447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbd897-ef24-4981-81ee-66a02f9ca316 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:08.723447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbd897-ef24-4981-81ee-66a02f9ca316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:08.743813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-96cbd897-ef24-4981-81ee-66a02f9ca316 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:25:08.745079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-96cbd897-ef24-4981-81ee-66a02f9ca316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:25:08.753866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 748/1495] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:25:08.758768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb046a74-dbc7-4f0c-ba3e-da63f026c426 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:25:08.769409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb046a74-dbc7-4f0c-ba3e-da63f026c426 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:25:08.775066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb50f6-9a57-42f5-846d-889bd434e818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:25:08.775727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb50f6-9a57-42f5-846d-889bd434e818 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:08.776036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb50f6-9a57-42f5-846d-889bd434e818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:08.776305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb50f6-9a57-42f5-846d-889bd434e818 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:08.777024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb50f6-9a57-42f5-846d-889bd434e818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:25:08.777324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb50f6-9a57-42f5-846d-889bd434e818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:25:08.778359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-3feb50f6-9a57-42f5-846d-889bd434e818 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:25:08.778359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 04 18:25:08.778359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: Jun 04 18:25:08.779249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb50f6-9a57-42f5-846d-889bd434e818 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:25:08.793420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 748/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:25:08.801897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbd897-ef24-4981-81ee-66a02f9ca316 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:25:08.812071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbd897-ef24-4981-81ee-66a02f9ca316 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:25:08.818269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57492e5-286d-4f7d-8ef4-d4a1abfe0e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:25:08.818920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57492e5-286d-4f7d-8ef4-d4a1abfe0e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:08.819200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57492e5-286d-4f7d-8ef4-d4a1abfe0e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:08.819468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57492e5-286d-4f7d-8ef4-d4a1abfe0e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:08.820166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57492e5-286d-4f7d-8ef4-d4a1abfe0e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:25:08.821910 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-c57492e5-286d-4f7d-8ef4-d4a1abfe0e62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:25:08.821910 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 04 18:25:08.821910 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: Jun 04 18:25:08.823101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57492e5-286d-4f7d-8ef4-d4a1abfe0e62 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:25:08.868554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 749/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:25:08 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:25:08.873037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb50f6-9a57-42f5-846d-889bd434e818 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:25:08.883388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb50f6-9a57-42f5-846d-889bd434e818 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:25:08.938907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2a4e6-6819-440f-999e-1f827997825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:25:08.939590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2a4e6-6819-440f-999e-1f827997825f admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:08.939869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2a4e6-6819-440f-999e-1f827997825f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:08.940181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2a4e6-6819-440f-999e-1f827997825f admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:08.940870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2a4e6-6819-440f-999e-1f827997825f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:25:08.941910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-d8c2a4e6-6819-440f-999e-1f827997825f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:25:08.941910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 04 18:25:08.941910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: Jun 04 18:25:08.943118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2a4e6-6819-440f-999e-1f827997825f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:25:08.965021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 749/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:25:08 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:25:08.969152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57492e5-286d-4f7d-8ef4-d4a1abfe0e62 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:25:08.979405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57492e5-286d-4f7d-8ef4-d4a1abfe0e62 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:25:08.985266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0b38c-7f32-4b8a-9b63-7e74729bbef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:25:08.985934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0b38c-7f32-4b8a-9b63-7e74729bbef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:08.986201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0b38c-7f32-4b8a-9b63-7e74729bbef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:08.986468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0b38c-7f32-4b8a-9b63-7e74729bbef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:08.987192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0b38c-7f32-4b8a-9b63-7e74729bbef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:25:08.988259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-13c0b38c-7f32-4b8a-9b63-7e74729bbef9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:25:08.988259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 04 18:25:08.988259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: Jun 04 18:25:08.989139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0b38c-7f32-4b8a-9b63-7e74729bbef9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:25:09.002678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 750/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:25:09.006868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2a4e6-6819-440f-999e-1f827997825f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:25:09.017301 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2a4e6-6819-440f-999e-1f827997825f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:25:09.022426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44a490-a848-4583-b671-031487bb49ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:25:09.023087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a490-a848-4583-b671-031487bb49ba admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:09.023368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a490-a848-4583-b671-031487bb49ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:09.023624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a490-a848-4583-b671-031487bb49ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:09.024413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44a490-a848-4583-b671-031487bb49ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:25:09.025448 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-1d44a490-a848-4583-b671-031487bb49ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:25:09.025448 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 04 18:25:09.025448 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: Jun 04 18:25:09.026361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44a490-a848-4583-b671-031487bb49ba admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:25:09.040538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 750/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:25:09.045635 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0b38c-7f32-4b8a-9b63-7e74729bbef9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:25:09.056253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0b38c-7f32-4b8a-9b63-7e74729bbef9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:25:09.061824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0516e0d-006a-4c9e-95fc-0f5dbf2fdc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:25:09.062737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0516e0d-006a-4c9e-95fc-0f5dbf2fdc3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:09.063016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0516e0d-006a-4c9e-95fc-0f5dbf2fdc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:09.063286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0516e0d-006a-4c9e-95fc-0f5dbf2fdc3f admin admin] PATH_INFO: `/v3/projects/ef397ee1b9034e668deb6d196eb76234/users/37c96e3e5c3a4883a8ad7e85fed39dfa/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:09.078388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0516e0d-006a-4c9e-95fc-0f5dbf2fdc3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef397ee1b9034e668deb6d196eb76234, user_id=37c96e3e5c3a4883a8ad7e85fed39dfa, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:25:09.079447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-a0516e0d-006a-4c9e-95fc-0f5dbf2fdc3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:25:09.079447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 04 18:25:09.079447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: Jun 04 18:25:09.081367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0516e0d-006a-4c9e-95fc-0f5dbf2fdc3f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:25:09.098093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 751/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:25:09 2022] PUT /identity/v3/projects/ef397ee1b9034e668deb6d196eb76234/users/37c96e3e5c3a4883a8ad7e85fed39dfa/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:25:09.110690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee292e99-7050-47c5-ada0-e3ecf800a989 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:09.110978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee292e99-7050-47c5-ada0-e3ecf800a989 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:09.111281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee292e99-7050-47c5-ada0-e3ecf800a989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:09.137196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ee292e99-7050-47c5-ada0-e3ecf800a989 None None] MFA Rules not processed for user `37c96e3e5c3a4883a8ad7e85fed39dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:25:09.138408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ee292e99-7050-47c5-ada0-e3ecf800a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:25:09.207877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 751/1502] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:25:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:25:09.221738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6ff2-57a9-479c-aa29-c79e5d96ff49 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:09.222031 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6ff2-57a9-479c-aa29-c79e5d96ff49 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:09.222336 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6ff2-57a9-479c-aa29-c79e5d96ff49 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:09.223789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 752/1503] 10.222.0.39 () {54 vars in 963 bytes} [Sat Jun 4 18:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:25:09.231060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79191-4c50-421d-a4d0-8cee3fc592f2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:09.231349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79191-4c50-421d-a4d0-8cee3fc592f2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:09.231629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79191-4c50-421d-a4d0-8cee3fc592f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:09.250790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-daf79191-4c50-421d-a4d0-8cee3fc592f2 None None] MFA Rules not processed for user `43023787db0749e8be546755f521755b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:25:09.251980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-daf79191-4c50-421d-a4d0-8cee3fc592f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:25:09.298164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:25:09.308063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 752/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Sat Jun 4 18:25:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:25:09.316483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a6ff2-57a9-479c-aa29-c79e5d96ff49 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:25:09.331637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a6ff2-57a9-479c-aa29-c79e5d96ff49 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:25:09.336476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c27fd9-5f4c-46c4-b40b-d426c394021f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:25:09.337119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c27fd9-5f4c-46c4-b40b-d426c394021f service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:09.337409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c27fd9-5f4c-46c4-b40b-d426c394021f service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:09.337685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c27fd9-5f4c-46c4-b40b-d426c394021f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:09.347570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c27fd9-5f4c-46c4-b40b-d426c394021f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:25:09.349038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c27fd9-5f4c-46c4-b40b-d426c394021f service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:25:09.358121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 753/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:25:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:25:09.405901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9b468-7d11-4648-bf58-f3d311355e59 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:09.406193 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9b468-7d11-4648-bf58-f3d311355e59 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:09.406475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9b468-7d11-4648-bf58-f3d311355e59 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:09.407792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 753/1506] 10.222.0.39 () {52 vars in 829 bytes} [Sat Jun 4 18:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:25:09.412623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c27fd9-5f4c-46c4-b40b-d426c394021f service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:25:09.478053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c27fd9-5f4c-46c4-b40b-d426c394021f service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:25:09.482922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:25:09.483800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:09.484110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:09.484383 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] PATH_INFO: `/v3/users/37c96e3e5c3a4883a8ad7e85fed39dfa` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:09.485596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c96e3e5c3a4883a8ad7e85fed39dfa)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:25:09.486620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:25:09.486620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 04 18:25:09.486620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: Jun 04 18:25:09.487817 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:25:09.561154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c96e3e5c3a4883a8ad7e85fed39dfa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:25:09.561911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c96e3e5c3a4883a8ad7e85fed39dfa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:25:09.580902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c96e3e5c3a4883a8ad7e85fed39dfa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:25:09.581553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c96e3e5c3a4883a8ad7e85fed39dfa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:25:09.594344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c96e3e5c3a4883a8ad7e85fed39dfa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:25:09.598331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:25:09.614670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 754/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:25:09 2022] DELETE /identity/v3/users/37c96e3e5c3a4883a8ad7e85fed39dfa => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:25:09.619248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c522d4-5c25-4d95-9099-ac4653fac503 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:09.619537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c522d4-5c25-4d95-9099-ac4653fac503 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:09.619860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c522d4-5c25-4d95-9099-ac4653fac503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:09.638384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-23c522d4-5c25-4d95-9099-ac4653fac503 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:25:09.639589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-23c522d4-5c25-4d95-9099-ac4653fac503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:25:09.703582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 754/1508] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:25:09.713892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:25:09.715496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:25:09.773274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67e73d-168d-4f9b-8c25-dd7b39bf391c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:25:09.777655 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650f23-44f4-4a5d-bb23-d51c634b64b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:25:09.778307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650f23-44f4-4a5d-bb23-d51c634b64b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:09.778596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650f23-44f4-4a5d-bb23-d51c634b64b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:09.778860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650f23-44f4-4a5d-bb23-d51c634b64b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:09.788351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650f23-44f4-4a5d-bb23-d51c634b64b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:25:09.789833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92650f23-44f4-4a5d-bb23-d51c634b64b1 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:25:09.799912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 755/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:25:10.138213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c522d4-5c25-4d95-9099-ac4653fac503 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:25:10.139703 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-23c522d4-5c25-4d95-9099-ac4653fac503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:25:10.153949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c522d4-5c25-4d95-9099-ac4653fac503 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:25:10.160094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:25:10.160972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:25:10.161250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:25:10.162106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] PATH_INFO: `/v3/projects/ef397ee1b9034e668deb6d196eb76234` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:25:10.163478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef397ee1b9034e668deb6d196eb76234)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:25:10.164594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:25:10.164594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 04 18:25:10.164594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: Jun 04 18:25:10.166027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:25:10.240792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef397ee1b9034e668deb6d196eb76234', 'request_id': 'req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:25:10.247924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef397ee1b9034e668deb6d196eb76234', 'request_id': 'req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:25:10.263397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef397ee1b9034e668deb6d196eb76234', 'request_id': 'req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:25:10.279618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] The token cache is being invalidate because project ef397ee1b9034e668deb6d196eb76234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:25:10.279903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:25:10.280619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe6b4e57-ea65-49af-b2a0-2e56dd6e2f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:25:10.282272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 755/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:25:10 2022] DELETE /identity/v3/projects/ef397ee1b9034e668deb6d196eb76234 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:25:19.795692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:25:20.276759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:26:47.223082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d079d-856f-468d-bd2f-11fb18cf4d87 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:47.224037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d079d-856f-468d-bd2f-11fb18cf4d87 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:47.224220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d079d-856f-468d-bd2f-11fb18cf4d87 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:47.226523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:26:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:26:47.234758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93831a-d54d-402c-b593-a8da49749e25 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:47.235538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93831a-d54d-402c-b593-a8da49749e25 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:47.235711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93831a-d54d-402c-b593-a8da49749e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:47.256287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bb93831a-d54d-402c-b593-a8da49749e25 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:26:47.257488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bb93831a-d54d-402c-b593-a8da49749e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:26:47.322679 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:26:47.492410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d079d-856f-468d-bd2f-11fb18cf4d87 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:26:47.495013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-323d079d-856f-468d-bd2f-11fb18cf4d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:26:47.581208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d079d-856f-468d-bd2f-11fb18cf4d87 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:26:47.588207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d45c6-0298-4a0d-a98e-74ab1cda75ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:26:47.588868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d45c6-0298-4a0d-a98e-74ab1cda75ed service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:47.589145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d45c6-0298-4a0d-a98e-74ab1cda75ed service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:47.589435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d45c6-0298-4a0d-a98e-74ab1cda75ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:47.598042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d45c6-0298-4a0d-a98e-74ab1cda75ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:26:47.599730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d45c6-0298-4a0d-a98e-74ab1cda75ed service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:26:47.609030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 757/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:26:48.485074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d200c9a-df02-4da8-8ebc-9a8fb1b3c47f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:48.485648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d200c9a-df02-4da8-8ebc-9a8fb1b3c47f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:48.485648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d200c9a-df02-4da8-8ebc-9a8fb1b3c47f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:48.487773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:26:48.492750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc26f-27f5-47e8-9552-9140dc790151 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:48.493197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc26f-27f5-47e8-9552-9140dc790151 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:48.493306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc26f-27f5-47e8-9552-9140dc790151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:48.512561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cf7bc26f-27f5-47e8-9552-9140dc790151 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:26:48.513795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cf7bc26f-27f5-47e8-9552-9140dc790151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:26:48.521724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:26:48.679625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d200c9a-df02-4da8-8ebc-9a8fb1b3c47f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:26:48.696387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d200c9a-df02-4da8-8ebc-9a8fb1b3c47f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:26:48.702487 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b63e6-258e-4cc8-89bc-2ea7a5d0f660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:26:48.703137 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b63e6-258e-4cc8-89bc-2ea7a5d0f660 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:48.703420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b63e6-258e-4cc8-89bc-2ea7a5d0f660 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:48.703699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b63e6-258e-4cc8-89bc-2ea7a5d0f660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:48.712487 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b63e6-258e-4cc8-89bc-2ea7a5d0f660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:26:48.714136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b63e6-258e-4cc8-89bc-2ea7a5d0f660 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:26:48.723779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 758/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:26:49.147798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc9a8e-b741-4284-9529-a7aaa254cd48 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:49.148057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc9a8e-b741-4284-9529-a7aaa254cd48 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:49.148282 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc9a8e-b741-4284-9529-a7aaa254cd48 None None] PATH_INFO: `/v3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:49.149624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 759/1517] 10.222.0.15 () {54 vars in 925 bytes} [Sat Jun 4 18:26:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:26:49.156468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0e62-4d75-4e38-bef0-5d77362488f7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:49.156761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0e62-4d75-4e38-bef0-5d77362488f7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:49.157043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0e62-4d75-4e38-bef0-5d77362488f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:49.177022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8a3d0e62-4d75-4e38-bef0-5d77362488f7 None None] MFA Rules not processed for user `9edcf71253ee4c81a402fffe13128b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:26:49.178200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8a3d0e62-4d75-4e38-bef0-5d77362488f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:26:49.246449 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 759/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Jun 4 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:26:53.275777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9d1d-bd1f-46f3-932f-007cb2860737 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:53.276748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9d1d-bd1f-46f3-932f-007cb2860737 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:53.276748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9d1d-bd1f-46f3-932f-007cb2860737 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:53.278952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 760/1519] 10.222.0.39 () {54 vars in 960 bytes} [Sat Jun 4 18:26:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:26:53.290628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e4b08-04d1-4e77-bc80-6fc520fe45d1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:53.291096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e4b08-04d1-4e77-bc80-6fc520fe45d1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:53.291581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e4b08-04d1-4e77-bc80-6fc520fe45d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:53.314680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-205e4b08-04d1-4e77-bc80-6fc520fe45d1 None None] MFA Rules not processed for user `9edcf71253ee4c81a402fffe13128b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:26:53.315904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-205e4b08-04d1-4e77-bc80-6fc520fe45d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:26:53.325402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 760/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Sat Jun 4 18:26:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:26:53.333733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe9d1d-bd1f-46f3-932f-007cb2860737 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:26:53.349945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe9d1d-bd1f-46f3-932f-007cb2860737 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:26:53.356174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df346e09-d6d8-4c06-b6f0-375145e5956f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:26:53.356854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df346e09-d6d8-4c06-b6f0-375145e5956f service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:26:53.357155 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df346e09-d6d8-4c06-b6f0-375145e5956f service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:26:53.357434 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df346e09-d6d8-4c06-b6f0-375145e5956f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:26:53.368537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df346e09-d6d8-4c06-b6f0-375145e5956f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:26:53.370165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df346e09-d6d8-4c06-b6f0-375145e5956f service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:26:53.380675 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 761/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:26:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:27:00.035598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fffe5c-aa2e-4011-82f2-25b76ecf4301 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:00.036500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fffe5c-aa2e-4011-82f2-25b76ecf4301 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:00.036500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fffe5c-aa2e-4011-82f2-25b76ecf4301 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:00.038765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:27:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:27:00.046219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285da87d-9556-48c4-b160-96d05d622f4e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:00.046672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285da87d-9556-48c4-b160-96d05d622f4e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:00.046773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285da87d-9556-48c4-b160-96d05d622f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:00.067194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-285da87d-9556-48c4-b160-96d05d622f4e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:27:00.068423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-285da87d-9556-48c4-b160-96d05d622f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:27:00.077015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:27:00.231965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fffe5c-aa2e-4011-82f2-25b76ecf4301 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:27:00.255020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fffe5c-aa2e-4011-82f2-25b76ecf4301 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:27:00.262148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d82bc-0a81-4749-9dc4-9b95307830f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:27:00.262795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d82bc-0a81-4749-9dc4-9b95307830f8 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:00.263074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d82bc-0a81-4749-9dc4-9b95307830f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:00.263349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d82bc-0a81-4749-9dc4-9b95307830f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:00.271903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d82bc-0a81-4749-9dc4-9b95307830f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:27:00.273704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d82bc-0a81-4749-9dc4-9b95307830f8 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:27:00.283110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 762/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:27:01.151456 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763d34b-58a7-4979-97a4-3547347c730d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:01.152069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763d34b-58a7-4979-97a4-3547347c730d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:01.152069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763d34b-58a7-4979-97a4-3547347c730d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:01.153423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 18:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:27:01.158548 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d5db-21e8-4a29-92e3-8d3d432d39ee None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:01.158992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d5db-21e8-4a29-92e3-8d3d432d39ee None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:01.159099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d5db-21e8-4a29-92e3-8d3d432d39ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:01.178649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3b64d5db-21e8-4a29-92e3-8d3d432d39ee None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:27:01.179863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3b64d5db-21e8-4a29-92e3-8d3d432d39ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:27:01.188173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 18:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:27:01.340955 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763d34b-58a7-4979-97a4-3547347c730d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:27:01.359996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763d34b-58a7-4979-97a4-3547347c730d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:27:01.366224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e621b-8010-43a7-8847-16e5355db056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:27:01.367525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e621b-8010-43a7-8847-16e5355db056 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:01.367828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e621b-8010-43a7-8847-16e5355db056 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:01.368134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e621b-8010-43a7-8847-16e5355db056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:01.377189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e621b-8010-43a7-8847-16e5355db056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:27:01.378846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e621b-8010-43a7-8847-16e5355db056 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:27:01.389597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 764/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:27:05.482468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7927e50-c850-4991-af3c-33cdf284ba8d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:05.483061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7927e50-c850-4991-af3c-33cdf284ba8d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:05.483061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7927e50-c850-4991-af3c-33cdf284ba8d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:05.484463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:27:05.490807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f1520-98c5-48cf-a232-3729fd76dff3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:05.491470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f1520-98c5-48cf-a232-3729fd76dff3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:05.491578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f1520-98c5-48cf-a232-3729fd76dff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:05.516833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-eb4f1520-98c5-48cf-a232-3729fd76dff3 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:27:05.518024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eb4f1520-98c5-48cf-a232-3729fd76dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:27:05.528051 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:27:05.568577 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7927e50-c850-4991-af3c-33cdf284ba8d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:27:05.571385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f7927e50-c850-4991-af3c-33cdf284ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:27:05.633878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7927e50-c850-4991-af3c-33cdf284ba8d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:27:05.638959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55619-5e2d-46a1-996e-22a4b0cfb4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:27:05.639636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55619-5e2d-46a1-996e-22a4b0cfb4da service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:05.639895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55619-5e2d-46a1-996e-22a4b0cfb4da service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:05.640210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55619-5e2d-46a1-996e-22a4b0cfb4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:05.650992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55619-5e2d-46a1-996e-22a4b0cfb4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:27:05.652490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55619-5e2d-46a1-996e-22a4b0cfb4da service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:27:05.657305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:27:05.663027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 765/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:27:07.872212 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3de17-5f89-49f9-9149-774bb559ccb6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:07.873116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3de17-5f89-49f9-9149-774bb559ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:07.873116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3de17-5f89-49f9-9149-774bb559ccb6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:07.875251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:27:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:27:07.884648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ea99a-952d-4833-acf2-7e7ee45e8a42 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:07.885282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ea99a-952d-4833-acf2-7e7ee45e8a42 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:07.885282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ea99a-952d-4833-acf2-7e7ee45e8a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:07.905421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-de9ea99a-952d-4833-acf2-7e7ee45e8a42 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:27:07.906639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-de9ea99a-952d-4833-acf2-7e7ee45e8a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:27:07.916925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:27:07.953103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3de17-5f89-49f9-9149-774bb559ccb6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:27:07.970210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3de17-5f89-49f9-9149-774bb559ccb6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:27:07.977518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec241f-47e9-4cc8-b168-8d520c77d9a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:27:07.978446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec241f-47e9-4cc8-b168-8d520c77d9a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:07.978746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec241f-47e9-4cc8-b168-8d520c77d9a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:07.979013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec241f-47e9-4cc8-b168-8d520c77d9a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:07.988579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec241f-47e9-4cc8-b168-8d520c77d9a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:27:07.990016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec241f-47e9-4cc8-b168-8d520c77d9a2 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:27:07.999549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 767/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:27:11.838806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e838-6061-45ba-9f7a-a3a295ac30d0 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:11.839403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e838-6061-45ba-9f7a-a3a295ac30d0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:11.839403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e838-6061-45ba-9f7a-a3a295ac30d0 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:11.840875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:27:11.848895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158432-ce44-4b0a-a0c6-1bc8745c5643 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:11.849352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158432-ce44-4b0a-a0c6-1bc8745c5643 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:11.849457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158432-ce44-4b0a-a0c6-1bc8745c5643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:11.857340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=62 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:27:11.872176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6d158432-ce44-4b0a-a0c6-1bc8745c5643 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:27:11.873379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6d158432-ce44-4b0a-a0c6-1bc8745c5643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:27:11.882139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:27:12.148733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45e838-6061-45ba-9f7a-a3a295ac30d0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:27:12.150760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ee45e838-6061-45ba-9f7a-a3a295ac30d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:27:12.214883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45e838-6061-45ba-9f7a-a3a295ac30d0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:27:12.218801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4b454-7b69-4de9-b8aa-c09aa8752512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:27:12.219448 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4b454-7b69-4de9-b8aa-c09aa8752512 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:12.219729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4b454-7b69-4de9-b8aa-c09aa8752512 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:12.220000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4b454-7b69-4de9-b8aa-c09aa8752512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:12.229316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4b454-7b69-4de9-b8aa-c09aa8752512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:27:12.230760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4b454-7b69-4de9-b8aa-c09aa8752512 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:27:12.240218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 768/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:27:14.467127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae8984-e538-49f6-bdc5-3d4621b8932e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:14.467806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae8984-e538-49f6-bdc5-3d4621b8932e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:14.467806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae8984-e538-49f6-bdc5-3d4621b8932e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:14.469096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 18:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:27:14.478051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd0e5-5a6f-4972-a3e9-2d0f2ca4abc9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:14.478793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd0e5-5a6f-4972-a3e9-2d0f2ca4abc9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:14.478931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fd0e5-5a6f-4972-a3e9-2d0f2ca4abc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:14.498983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7c3fd0e5-5a6f-4972-a3e9-2d0f2ca4abc9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:27:14.500229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7c3fd0e5-5a6f-4972-a3e9-2d0f2ca4abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:27:14.508560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:27:14.776361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae8984-e538-49f6-bdc5-3d4621b8932e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:27:14.778838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8eae8984-e538-49f6-bdc5-3d4621b8932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:27:14.795862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae8984-e538-49f6-bdc5-3d4621b8932e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:27:14.801359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f6a6b-0533-4449-9afd-52c49958fcb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:27:14.802375 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f6a6b-0533-4449-9afd-52c49958fcb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:27:14.802814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f6a6b-0533-4449-9afd-52c49958fcb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:27:14.803248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f6a6b-0533-4449-9afd-52c49958fcb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:27:14.816281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f6a6b-0533-4449-9afd-52c49958fcb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:27:14.817649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f6a6b-0533-4449-9afd-52c49958fcb4 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:27:14.827363 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 770/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:27:24.493399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=32 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:27:24.823342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=8 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:44.799226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc78fb5-07be-4e0b-b831-96883378e891 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:44.799911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc78fb5-07be-4e0b-b831-96883378e891 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:44.799911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc78fb5-07be-4e0b-b831-96883378e891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:44.833481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-dfc78fb5-07be-4e0b-b831-96883378e891 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:44.834744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dfc78fb5-07be-4e0b-b831-96883378e891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:44.845421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 770/1540] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:44.854768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a2960-2847-4052-b5cd-083e13c47aa0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:44.855801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a2960-2847-4052-b5cd-083e13c47aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:44.856335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a2960-2847-4052-b5cd-083e13c47aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:44.891629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-db2a2960-2847-4052-b5cd-083e13c47aa0 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:44.897102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-db2a2960-2847-4052-b5cd-083e13c47aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:44.910527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 771/1541] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:44.915109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc78fb5-07be-4e0b-b831-96883378e891 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:44.927413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc78fb5-07be-4e0b-b831-96883378e891 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:44.942167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cceda6-dfcf-4109-a480-0e8eda4e4b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:44.943046 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cceda6-dfcf-4109-a480-0e8eda4e4b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:44.943327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cceda6-dfcf-4109-a480-0e8eda4e4b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:44.943602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cceda6-dfcf-4109-a480-0e8eda4e4b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:44.944372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cceda6-dfcf-4109-a480-0e8eda4e4b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:28:44.944676 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cceda6-dfcf-4109-a480-0e8eda4e4b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:44.946414 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cceda6-dfcf-4109-a480-0e8eda4e4b7d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:44.965872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7f5c-18ce-498a-95ae-394740af9aa2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:44.966536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7f5c-18ce-498a-95ae-394740af9aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:44.967376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7f5c-18ce-498a-95ae-394740af9aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:44.968971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 771/1542] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:28:44.977328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cceda6-dfcf-4109-a480-0e8eda4e4b7d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:44.992183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cceda6-dfcf-4109-a480-0e8eda4e4b7d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:44.996998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8d9d7f5c-18ce-498a-95ae-394740af9aa2 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:44.998974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8d9d7f5c-18ce-498a-95ae-394740af9aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.004742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e843be-a683-4e42-bbaf-836b42e9bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.005542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e843be-a683-4e42-bbaf-836b42e9bc57 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.005834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e843be-a683-4e42-bbaf-836b42e9bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.006106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e843be-a683-4e42-bbaf-836b42e9bc57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.007087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e843be-a683-4e42-bbaf-836b42e9bc57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-59e843be-a683-4e42-bbaf-836b42e9bc57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:28:45.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 04 18:28:45.008166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: Jun 04 18:28:45.009526 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e843be-a683-4e42-bbaf-836b42e9bc57 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.016185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 772/1543] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.025221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd101aa0-8e30-4d86-b285-3efc2f960314 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.025883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd101aa0-8e30-4d86-b285-3efc2f960314 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.026370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd101aa0-8e30-4d86-b285-3efc2f960314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.074107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fd101aa0-8e30-4d86-b285-3efc2f960314 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.075725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fd101aa0-8e30-4d86-b285-3efc2f960314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.076664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 772/1544] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:44 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:28:45.081233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e843be-a683-4e42-bbaf-836b42e9bc57 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.189587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e843be-a683-4e42-bbaf-836b42e9bc57 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.199844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 773/1545] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:28:45.202424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5ac5-4aac-439d-995a-4c11f68aaf17 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.203385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53c11c-bb60-499b-ab7d-3c43603f8f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.204640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53c11c-bb60-499b-ab7d-3c43603f8f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.205165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53c11c-bb60-499b-ab7d-3c43603f8f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.205670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53c11c-bb60-499b-ab7d-3c43603f8f00 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.206602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53c11c-bb60-499b-ab7d-3c43603f8f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.207116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5ac5-4aac-439d-995a-4c11f68aaf17 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.209325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53c11c-bb60-499b-ab7d-3c43603f8f00 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.209824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5ac5-4aac-439d-995a-4c11f68aaf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.239922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ceee5ac5-4aac-439d-995a-4c11f68aaf17 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.241553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ceee5ac5-4aac-439d-995a-4c11f68aaf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.257049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 773/1546] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:45.259022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7603a-ebc4-4ed8-a819-43f039d2cd7e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.259522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7603a-ebc4-4ed8-a819-43f039d2cd7e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.260090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7603a-ebc4-4ed8-a819-43f039d2cd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.268345 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 774/1547] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.268345 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee5ac5-4aac-439d-995a-4c11f68aaf17 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.299863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee5ac5-4aac-439d-995a-4c11f68aaf17 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.315721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ccf7603a-ebc4-4ed8-a819-43f039d2cd7e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.316066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277601a4-89e2-437a-bfb4-4dc5c0670f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.317214 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277601a4-89e2-437a-bfb4-4dc5c0670f9c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.317696 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277601a4-89e2-437a-bfb4-4dc5c0670f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.318010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277601a4-89e2-437a-bfb4-4dc5c0670f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.318247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ccf7603a-ebc4-4ed8-a819-43f039d2cd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.318882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277601a4-89e2-437a-bfb4-4dc5c0670f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:28:45.319189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277601a4-89e2-437a-bfb4-4dc5c0670f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.320293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-277601a4-89e2-437a-bfb4-4dc5c0670f9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:28:45.320293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 04 18:28:45.320293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: Jun 04 18:28:45.321603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277601a4-89e2-437a-bfb4-4dc5c0670f9c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.329521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 774/1548] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.331860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d94be-90c0-410d-a7e3-c83a1587ea9b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.332254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d94be-90c0-410d-a7e3-c83a1587ea9b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.332755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d94be-90c0-410d-a7e3-c83a1587ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.337250 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 775/1549] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:28:45.338568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277601a4-89e2-437a-bfb4-4dc5c0670f9c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.355667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277601a4-89e2-437a-bfb4-4dc5c0670f9c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.360373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-955d94be-90c0-410d-a7e3-c83a1587ea9b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.361226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed6ace-0d59-4a72-86f9-0fecf669494c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.361569 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-955d94be-90c0-410d-a7e3-c83a1587ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.362202 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed6ace-0d59-4a72-86f9-0fecf669494c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.362493 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed6ace-0d59-4a72-86f9-0fecf669494c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.362767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed6ace-0d59-4a72-86f9-0fecf669494c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.363492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed6ace-0d59-4a72-86f9-0fecf669494c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.365131 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed6ace-0d59-4a72-86f9-0fecf669494c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.371761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 775/1550] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.376682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f641f-f3a4-4c1f-85d7-eff806378070 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.376682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f641f-f3a4-4c1f-85d7-eff806378070 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.376682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f641f-f3a4-4c1f-85d7-eff806378070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.376989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 776/1551] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:45.379288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804803c-dc96-45b6-9626-9ce51a97d404 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.379288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804803c-dc96-45b6-9626-9ce51a97d404 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.379288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804803c-dc96-45b6-9626-9ce51a97d404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.398799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b804803c-dc96-45b6-9626-9ce51a97d404 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.399010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-756f641f-f3a4-4c1f-85d7-eff806378070 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.400013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b804803c-dc96-45b6-9626-9ce51a97d404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.400126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-756f641f-f3a4-4c1f-85d7-eff806378070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.407944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 776/1552] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.411807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 777/1553] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.411807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804803c-dc96-45b6-9626-9ce51a97d404 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.412825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae95c-4c5d-4e76-94de-f48a279e7053 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.413111 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae95c-4c5d-4e76-94de-f48a279e7053 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.413383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae95c-4c5d-4e76-94de-f48a279e7053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.430134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804803c-dc96-45b6-9626-9ce51a97d404 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.434500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5dcae95c-4c5d-4e76-94de-f48a279e7053 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.434851 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c7d4-a1c2-4ffc-8ed0-6bd1921dbfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.435517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c7d4-a1c2-4ffc-8ed0-6bd1921dbfba admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.435688 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5dcae95c-4c5d-4e76-94de-f48a279e7053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.435789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c7d4-a1c2-4ffc-8ed0-6bd1921dbfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.436202 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c7d4-a1c2-4ffc-8ed0-6bd1921dbfba admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.437463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c7d4-a1c2-4ffc-8ed0-6bd1921dbfba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.440116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c7d4-a1c2-4ffc-8ed0-6bd1921dbfba admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.443872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 777/1554] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.445602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc5a9a-64f6-4cc3-bf9e-71b45c2ab822 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.445893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc5a9a-64f6-4cc3-bf9e-71b45c2ab822 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.446167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc5a9a-64f6-4cc3-bf9e-71b45c2ab822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.465805 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-35cc5a9a-64f6-4cc3-bf9e-71b45c2ab822 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.467009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-35cc5a9a-64f6-4cc3-bf9e-71b45c2ab822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.469619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 778/1555] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:45.470594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c7d4-a1c2-4ffc-8ed0-6bd1921dbfba admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.528374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 778/1556] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.530969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52f334-8788-497a-bf5b-28732c4392b9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.531269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52f334-8788-497a-bf5b-28732c4392b9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.531549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52f334-8788-497a-bf5b-28732c4392b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.532694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c7d4-a1c2-4ffc-8ed0-6bd1921dbfba admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.537198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9c0a-cd8f-4523-b9cc-b2f44dccca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.537901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9c0a-cd8f-4523-b9cc-b2f44dccca15 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.538188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9c0a-cd8f-4523-b9cc-b2f44dccca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.538469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9c0a-cd8f-4523-b9cc-b2f44dccca15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.539201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec9c0a-cd8f-4523-b9cc-b2f44dccca15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.541206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec9c0a-cd8f-4523-b9cc-b2f44dccca15 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.551118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-cd52f334-8788-497a-bf5b-28732c4392b9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.552164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 779/1557] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:45.552408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cd52f334-8788-497a-bf5b-28732c4392b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.553054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9c0a-cd8f-4523-b9cc-b2f44dccca15 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.560531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 779/1558] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.562285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f96db-c994-4ae3-8e5e-ffca9d9847c9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.562576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f96db-c994-4ae3-8e5e-ffca9d9847c9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.562849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f96db-c994-4ae3-8e5e-ffca9d9847c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.567307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9c0a-cd8f-4523-b9cc-b2f44dccca15 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.571911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3557153-32ec-46de-81e3-874db8adf163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.572607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557153-32ec-46de-81e3-874db8adf163 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.572892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557153-32ec-46de-81e3-874db8adf163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.573170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3557153-32ec-46de-81e3-874db8adf163 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.573895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3557153-32ec-46de-81e3-874db8adf163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:28:45.574204 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3557153-32ec-46de-81e3-874db8adf163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.575813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3557153-32ec-46de-81e3-874db8adf163 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.580536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7d6f96db-c994-4ae3-8e5e-ffca9d9847c9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.581679 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7d6f96db-c994-4ae3-8e5e-ffca9d9847c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.587587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 780/1559] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:28:45.588842 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05706f-8bf7-4d6a-b6d3-2125b592adee None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.589133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05706f-8bf7-4d6a-b6d3-2125b592adee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.589421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05706f-8bf7-4d6a-b6d3-2125b592adee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.590069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 780/1560] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.594354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f96db-c994-4ae3-8e5e-ffca9d9847c9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.604314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f96db-c994-4ae3-8e5e-ffca9d9847c9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.607389 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ee05706f-8bf7-4d6a-b6d3-2125b592adee None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.608867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ee05706f-8bf7-4d6a-b6d3-2125b592adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.609870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854bdaf-435b-4d51-8f76-4b0cc0363d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.610537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854bdaf-435b-4d51-8f76-4b0cc0363d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.610811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854bdaf-435b-4d51-8f76-4b0cc0363d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.611092 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854bdaf-435b-4d51-8f76-4b0cc0363d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.611920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854bdaf-435b-4d51-8f76-4b0cc0363d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:28:45.612255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854bdaf-435b-4d51-8f76-4b0cc0363d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.613876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854bdaf-435b-4d51-8f76-4b0cc0363d49 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.617109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:45.617223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 781/1561] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.624974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05706f-8bf7-4d6a-b6d3-2125b592adee None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.628956 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 781/1562] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:28:45.630353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045f754-43c4-42a3-bad5-810b685b4802 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.630638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045f754-43c4-42a3-bad5-810b685b4802 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.630911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045f754-43c4-42a3-bad5-810b685b4802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.638299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:45.643311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05706f-8bf7-4d6a-b6d3-2125b592adee None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.650954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb838-e025-448c-af22-52c442842861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.651848 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb838-e025-448c-af22-52c442842861 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.652183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb838-e025-448c-af22-52c442842861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.652374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5045f754-43c4-42a3-bad5-810b685b4802 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.652495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cb838-e025-448c-af22-52c442842861 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.653169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cb838-e025-448c-af22-52c442842861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.653550 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5045f754-43c4-42a3-bad5-810b685b4802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.654209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-a77cb838-e025-448c-af22-52c442842861 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:28:45.654209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 04 18:28:45.654209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: Jun 04 18:28:45.655523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cb838-e025-448c-af22-52c442842861 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.661934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 782/1563] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.662542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045f754-43c4-42a3-bad5-810b685b4802 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.673797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045f754-43c4-42a3-bad5-810b685b4802 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.677498 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 782/1564] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/users => generated 286 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:45.678379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb838-e025-448c-af22-52c442842861 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.681458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517708d0-e892-40f6-95b9-f5845712aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.682365 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517708d0-e892-40f6-95b9-f5845712aff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.682649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517708d0-e892-40f6-95b9-f5845712aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.682926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517708d0-e892-40f6-95b9-f5845712aff4 admin admin] PATH_INFO: `/v3/projects/92f0edfa8c0349a695483cbc9bf73937/users/f3c5fd8875524227a887d2cb5a268a44/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.691212 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cb838-e025-448c-af22-52c442842861 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.696549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba5fbf-6783-4659-aa25-565d743826f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.697239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5fbf-6783-4659-aa25-565d743826f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.697495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5fbf-6783-4659-aa25-565d743826f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.697769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba5fbf-6783-4659-aa25-565d743826f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.698528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba5fbf-6783-4659-aa25-565d743826f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:28:45.698836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba5fbf-6783-4659-aa25-565d743826f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.698977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517708d0-e892-40f6-95b9-f5845712aff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f0edfa8c0349a695483cbc9bf73937, user_id=f3c5fd8875524227a887d2cb5a268a44, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.699955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-517708d0-e892-40f6-95b9-f5845712aff4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:28:45.699955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 04 18:28:45.699955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: Jun 04 18:28:45.700481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba5fbf-6783-4659-aa25-565d743826f9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.701980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517708d0-e892-40f6-95b9-f5845712aff4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.713934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 783/1565] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:28:45.724237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba5fbf-6783-4659-aa25-565d743826f9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.724351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 783/1566] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:45 2022] PUT /identity/v3/projects/92f0edfa8c0349a695483cbc9bf73937/users/f3c5fd8875524227a887d2cb5a268a44/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:45.724351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517708d0-e892-40f6-95b9-f5845712aff4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.729972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba5fbf-6783-4659-aa25-565d743826f9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.784262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517708d0-e892-40f6-95b9-f5845712aff4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.788886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4514d22-5363-451e-bf62-ee30ec3905d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.789465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8460d23-5dc1-45d5-ae00-870d867d353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.789603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514d22-5363-451e-bf62-ee30ec3905d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.789810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514d22-5363-451e-bf62-ee30ec3905d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.790079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514d22-5363-451e-bf62-ee30ec3905d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.790176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460d23-5dc1-45d5-ae00-870d867d353d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.790764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460d23-5dc1-45d5-ae00-870d867d353d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.791048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8460d23-5dc1-45d5-ae00-870d867d353d admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.791185 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4514d22-5363-451e-bf62-ee30ec3905d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.791772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8460d23-5dc1-45d5-ae00-870d867d353d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:28:45.792110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8460d23-5dc1-45d5-ae00-870d867d353d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.793087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4514d22-5363-451e-bf62-ee30ec3905d4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.793703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8460d23-5dc1-45d5-ae00-870d867d353d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.805641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 784/1567] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:28:45.806880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a45f-9338-434a-9540-df5648451a6e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.807165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a45f-9338-434a-9540-df5648451a6e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.807443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a45f-9338-434a-9540-df5648451a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.825793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7257a45f-9338-434a-9540-df5648451a6e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.829558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 784/1568] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:45.829558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4514d22-5363-451e-bf62-ee30ec3905d4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.830166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7257a45f-9338-434a-9540-df5648451a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.886890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 785/1569] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:45.887738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a45f-9338-434a-9540-df5648451a6e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.892433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4514d22-5363-451e-bf62-ee30ec3905d4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.896971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a45f-9338-434a-9540-df5648451a6e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.897136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaddbcc-2a86-4a62-8638-e58b436224dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.897780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddbcc-2a86-4a62-8638-e58b436224dc admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.898086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddbcc-2a86-4a62-8638-e58b436224dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.898368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddbcc-2a86-4a62-8638-e58b436224dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.899070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaddbcc-2a86-4a62-8638-e58b436224dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.901047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaddbcc-2a86-4a62-8638-e58b436224dc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.901688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439ec82-8bf8-477c-9a1b-161964712867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.902381 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439ec82-8bf8-477c-9a1b-161964712867 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.902661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439ec82-8bf8-477c-9a1b-161964712867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.902956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439ec82-8bf8-477c-9a1b-161964712867 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.903673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439ec82-8bf8-477c-9a1b-161964712867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:28:45.903971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439ec82-8bf8-477c-9a1b-161964712867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.905658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439ec82-8bf8-477c-9a1b-161964712867 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:45.917959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 786/1570] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:28:45.918960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439ec82-8bf8-477c-9a1b-161964712867 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:45.929957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439ec82-8bf8-477c-9a1b-161964712867 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:45.931737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 785/1571] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:45.933204 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40fa32-220a-4fa6-ba44-c6e59882c2ee None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.933500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40fa32-220a-4fa6-ba44-c6e59882c2ee None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.933749 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40fa32-220a-4fa6-ba44-c6e59882c2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.960657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-cb40fa32-220a-4fa6-ba44-c6e59882c2ee None None] MFA Rules not processed for user `f3c5fd8875524227a887d2cb5a268a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:45.961772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cb40fa32-220a-4fa6-ba44-c6e59882c2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:45.981773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:45.985564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:45.991330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfd85f-b8ec-48ae-963f-930c81d8e7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:45.992124 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfd85f-b8ec-48ae-963f-930c81d8e7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:45.992525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfd85f-b8ec-48ae-963f-930c81d8e7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:45.992868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfd85f-b8ec-48ae-963f-930c81d8e7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:45.993637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfd85f-b8ec-48ae-963f-930c81d8e7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:45.995441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfd85f-b8ec-48ae-963f-930c81d8e7c6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.005988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 787/1572] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.008980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfd85f-b8ec-48ae-963f-930c81d8e7c6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.018432 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfd85f-b8ec-48ae-963f-930c81d8e7c6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.022858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec37db-d810-4409-a118-76c1370d8a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.023495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec37db-d810-4409-a118-76c1370d8a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.023772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec37db-d810-4409-a118-76c1370d8a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.024074 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec37db-d810-4409-a118-76c1370d8a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.024762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec37db-d810-4409-a118-76c1370d8a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.026666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec37db-d810-4409-a118-76c1370d8a7e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.028160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 786/1573] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:46.029035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40fa32-220a-4fa6-ba44-c6e59882c2ee None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.042888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40fa32-220a-4fa6-ba44-c6e59882c2ee None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.047424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f77293-0f2c-4f4d-bfd7-bb8d5767c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.048122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f77293-0f2c-4f4d-bfd7-bb8d5767c182 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.048389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f77293-0f2c-4f4d-bfd7-bb8d5767c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.048667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f77293-0f2c-4f4d-bfd7-bb8d5767c182 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.049372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f77293-0f2c-4f4d-bfd7-bb8d5767c182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.051528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f77293-0f2c-4f4d-bfd7-bb8d5767c182 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.059428 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 788/1574] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:46.060236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec37db-d810-4409-a118-76c1370d8a7e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.078334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 787/1575] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:46.079160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f77293-0f2c-4f4d-bfd7-bb8d5767c182 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.125425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec37db-d810-4409-a118-76c1370d8a7e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.141342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f77293-0f2c-4f4d-bfd7-bb8d5767c182 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.146904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4d58c-885d-4c24-ae3c-bb5e9d4fb6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.147578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4d58c-885d-4c24-ae3c-bb5e9d4fb6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.147892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4d58c-885d-4c24-ae3c-bb5e9d4fb6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.148195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4d58c-885d-4c24-ae3c-bb5e9d4fb6f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.149322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4d58c-885d-4c24-ae3c-bb5e9d4fb6f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:28:46.149634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4d58c-885d-4c24-ae3c-bb5e9d4fb6f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.151639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4d58c-885d-4c24-ae3c-bb5e9d4fb6f7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.172034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 788/1576] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:28:46.172034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4d58c-885d-4c24-ae3c-bb5e9d4fb6f7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.177455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4d58c-885d-4c24-ae3c-bb5e9d4fb6f7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.181246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ee7b7-a97e-447f-8f87-a85db5961ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.181922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ee7b7-a97e-447f-8f87-a85db5961ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.182198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ee7b7-a97e-447f-8f87-a85db5961ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.182443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ee7b7-a97e-447f-8f87-a85db5961ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.183051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8fedd-a882-4dc7-a225-2fe01960917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.183173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ee7b7-a97e-447f-8f87-a85db5961ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.183705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8fedd-a882-4dc7-a225-2fe01960917b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.183990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8fedd-a882-4dc7-a225-2fe01960917b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.184292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8fedd-a882-4dc7-a225-2fe01960917b admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.184989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8fedd-a882-4dc7-a225-2fe01960917b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.185112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ee7b7-a97e-447f-8f87-a85db5961ea9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.186944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8fedd-a882-4dc7-a225-2fe01960917b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.207964 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 789/1577] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:46.209075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ee7b7-a97e-447f-8f87-a85db5961ea9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.217060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 789/1578] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:46.217885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8fedd-a882-4dc7-a225-2fe01960917b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.219440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ee7b7-a97e-447f-8f87-a85db5961ea9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.277710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042c264-5a42-4217-9e5f-2a5e700c0e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.278537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042c264-5a42-4217-9e5f-2a5e700c0e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.278819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042c264-5a42-4217-9e5f-2a5e700c0e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.279577 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042c264-5a42-4217-9e5f-2a5e700c0e46 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.280493 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042c264-5a42-4217-9e5f-2a5e700c0e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.282420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042c264-5a42-4217-9e5f-2a5e700c0e46 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.283231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8fedd-a882-4dc7-a225-2fe01960917b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.287742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a12d-6f13-4603-ac68-461f80e10740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.288440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a12d-6f13-4603-ac68-461f80e10740 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.288726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a12d-6f13-4603-ac68-461f80e10740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.289005 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a12d-6f13-4603-ac68-461f80e10740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.289730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34a12d-6f13-4603-ac68-461f80e10740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.291678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34a12d-6f13-4603-ac68-461f80e10740 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.292816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:46.303201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 790/1579] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.305318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a12d-6f13-4603-ac68-461f80e10740 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.315615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 790/1580] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:46.316301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042c264-5a42-4217-9e5f-2a5e700c0e46 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.321716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:46.325685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042c264-5a42-4217-9e5f-2a5e700c0e46 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.330420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67b54f-277b-4796-aaad-c54cf5ecf3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.331081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67b54f-277b-4796-aaad-c54cf5ecf3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.331379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67b54f-277b-4796-aaad-c54cf5ecf3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.331659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67b54f-277b-4796-aaad-c54cf5ecf3d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.332381 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67b54f-277b-4796-aaad-c54cf5ecf3d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.334334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67b54f-277b-4796-aaad-c54cf5ecf3d9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.359045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 791/1581] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:46.359045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67b54f-277b-4796-aaad-c54cf5ecf3d9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.366099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67b54f-277b-4796-aaad-c54cf5ecf3d9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.367083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34a12d-6f13-4603-ac68-461f80e10740 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.370542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2aff8-35be-41fe-a9ba-d9e232acbee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.370701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0197068-8ede-4b5a-a2ec-ae3c15834792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.371197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2aff8-35be-41fe-a9ba-d9e232acbee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.371324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197068-8ede-4b5a-a2ec-ae3c15834792 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.371491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2aff8-35be-41fe-a9ba-d9e232acbee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.371591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197068-8ede-4b5a-a2ec-ae3c15834792 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.371795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2aff8-35be-41fe-a9ba-d9e232acbee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.371893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197068-8ede-4b5a-a2ec-ae3c15834792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.372468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2aff8-35be-41fe-a9ba-d9e232acbee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.374534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2aff8-35be-41fe-a9ba-d9e232acbee2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.397689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 792/1582] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/users => generated 278 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:46.398596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2aff8-35be-41fe-a9ba-d9e232acbee2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.409139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2aff8-35be-41fe-a9ba-d9e232acbee2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.414615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bec2c9-1595-4751-95f4-fc1b05ec65ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.420471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bec2c9-1595-4751-95f4-fc1b05ec65ee admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.420471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bec2c9-1595-4751-95f4-fc1b05ec65ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.420471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bec2c9-1595-4751-95f4-fc1b05ec65ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.420471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bec2c9-1595-4751-95f4-fc1b05ec65ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.420471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bec2c9-1595-4751-95f4-fc1b05ec65ee admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.434624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0197068-8ede-4b5a-a2ec-ae3c15834792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.436883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0197068-8ede-4b5a-a2ec-ae3c15834792 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.446082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 793/1583] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:46.446519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 791/1584] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:46.447318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0197068-8ede-4b5a-a2ec-ae3c15834792 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.447774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bec2c9-1595-4751-95f4-fc1b05ec65ee admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.458369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0197068-8ede-4b5a-a2ec-ae3c15834792 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.511089 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bec2c9-1595-4751-95f4-fc1b05ec65ee admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.515997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7bf38-4c37-4b8a-902d-61e622ae4315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.516691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7bf38-4c37-4b8a-902d-61e622ae4315 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.516973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7bf38-4c37-4b8a-902d-61e622ae4315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.517253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7bf38-4c37-4b8a-902d-61e622ae4315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.517887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25007685-6d3f-4143-a454-efa7759262bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.518002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7bf38-4c37-4b8a-902d-61e622ae4315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.518582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25007685-6d3f-4143-a454-efa7759262bd admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.518954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25007685-6d3f-4143-a454-efa7759262bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.519303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25007685-6d3f-4143-a454-efa7759262bd admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.519564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7bf38-4c37-4b8a-902d-61e622ae4315 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.520166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25007685-6d3f-4143-a454-efa7759262bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.522491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25007685-6d3f-4143-a454-efa7759262bd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.530211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 794/1585] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.530860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7bf38-4c37-4b8a-902d-61e622ae4315 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.541763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7bf38-4c37-4b8a-902d-61e622ae4315 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.546905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e25712-b39a-461f-9070-8443ab9146c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.550527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 792/1586] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:46.550665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e25712-b39a-461f-9070-8443ab9146c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.550665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e25712-b39a-461f-9070-8443ab9146c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.550864 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25007685-6d3f-4143-a454-efa7759262bd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.550967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e25712-b39a-461f-9070-8443ab9146c2 admin admin] PATH_INFO: `/v3/projects/9702c61600da49e29c12cbedfaf40308/users/5ea5abd67bcb4818a5f601561039522d/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.561011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25007685-6d3f-4143-a454-efa7759262bd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.565528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e25712-b39a-461f-9070-8443ab9146c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9702c61600da49e29c12cbedfaf40308, user_id=5ea5abd67bcb4818a5f601561039522d, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.566611 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed353e0-30dd-49b8-b611-b890244b0f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.567297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed353e0-30dd-49b8-b611-b890244b0f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.567587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed353e0-30dd-49b8-b611-b890244b0f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.567868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed353e0-30dd-49b8-b611-b890244b0f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.568236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e25712-b39a-461f-9070-8443ab9146c2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.569122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed353e0-30dd-49b8-b611-b890244b0f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.570757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed353e0-30dd-49b8-b611-b890244b0f75 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.582146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 793/1587] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.582983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed353e0-30dd-49b8-b611-b890244b0f75 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.588038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 795/1588] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:46 2022] PUT /identity/v3/projects/9702c61600da49e29c12cbedfaf40308/users/5ea5abd67bcb4818a5f601561039522d/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:46.588038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e25712-b39a-461f-9070-8443ab9146c2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.598099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed353e0-30dd-49b8-b611-b890244b0f75 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.643264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:46.655803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e25712-b39a-461f-9070-8443ab9146c2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.660880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20a903-1db1-44c5-90c1-d7c0e7788057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.661561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20a903-1db1-44c5-90c1-d7c0e7788057 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.661846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20a903-1db1-44c5-90c1-d7c0e7788057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.662197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20a903-1db1-44c5-90c1-d7c0e7788057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.662312 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625aca2-9b2a-4d0c-89a2-39fdd1ddaf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.662932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20a903-1db1-44c5-90c1-d7c0e7788057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.663051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625aca2-9b2a-4d0c-89a2-39fdd1ddaf53 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.663335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625aca2-9b2a-4d0c-89a2-39fdd1ddaf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.663775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625aca2-9b2a-4d0c-89a2-39fdd1ddaf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.664625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625aca2-9b2a-4d0c-89a2-39fdd1ddaf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.664718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20a903-1db1-44c5-90c1-d7c0e7788057 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.666573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625aca2-9b2a-4d0c-89a2-39fdd1ddaf53 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.678772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 796/1589] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.678772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20a903-1db1-44c5-90c1-d7c0e7788057 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.679086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 794/1590] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.679086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625aca2-9b2a-4d0c-89a2-39fdd1ddaf53 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.689704 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20a903-1db1-44c5-90c1-d7c0e7788057 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.695302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf35764-c692-4984-9798-cda501951dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.695984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf35764-c692-4984-9798-cda501951dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.696291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf35764-c692-4984-9798-cda501951dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.696398 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625aca2-9b2a-4d0c-89a2-39fdd1ddaf53 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.696628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf35764-c692-4984-9798-cda501951dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.697335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf35764-c692-4984-9798-cda501951dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.699347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf35764-c692-4984-9798-cda501951dfb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.702624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d2975-2f89-4b5b-995d-f7747767e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.703392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d2975-2f89-4b5b-995d-f7747767e6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.703742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d2975-2f89-4b5b-995d-f7747767e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.704256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d2975-2f89-4b5b-995d-f7747767e6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.705625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d2975-2f89-4b5b-995d-f7747767e6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.707043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:46.707607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d2975-2f89-4b5b-995d-f7747767e6c2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.723961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 795/1591] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.724896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d2975-2f89-4b5b-995d-f7747767e6c2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.731536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 797/1592] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:46.732650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf35764-c692-4984-9798-cda501951dfb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.739464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d2975-2f89-4b5b-995d-f7747767e6c2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.743391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf35764-c692-4984-9798-cda501951dfb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.745465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b43d11-3504-4b21-99ac-8e05da2750bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.746213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43d11-3504-4b21-99ac-8e05da2750bc admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.746626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43d11-3504-4b21-99ac-8e05da2750bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.746871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b43d11-3504-4b21-99ac-8e05da2750bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.747954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b43d11-3504-4b21-99ac-8e05da2750bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.748783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfa927-ec4e-4ac3-926c-5d58aba7328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.749467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfa927-ec4e-4ac3-926c-5d58aba7328b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.749917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfa927-ec4e-4ac3-926c-5d58aba7328b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.750031 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b43d11-3504-4b21-99ac-8e05da2750bc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.750219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfa927-ec4e-4ac3-926c-5d58aba7328b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.750889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfa927-ec4e-4ac3-926c-5d58aba7328b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.752514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfa927-ec4e-4ac3-926c-5d58aba7328b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.761010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 796/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.761010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82475e0-f224-46dc-8f27-b5f175902648 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.761010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82475e0-f224-46dc-8f27-b5f175902648 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.761010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82475e0-f224-46dc-8f27-b5f175902648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.764836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 798/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.764937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfa927-ec4e-4ac3-926c-5d58aba7328b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.776042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfa927-ec4e-4ac3-926c-5d58aba7328b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.781307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae6038-f084-49e9-8043-1ec6ce54e541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.782098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6038-f084-49e9-8043-1ec6ce54e541 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.782378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6038-f084-49e9-8043-1ec6ce54e541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.782649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6038-f084-49e9-8043-1ec6ce54e541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.783369 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae6038-f084-49e9-8043-1ec6ce54e541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.785012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae6038-f084-49e9-8043-1ec6ce54e541 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.794000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a82475e0-f224-46dc-8f27-b5f175902648 None None] MFA Rules not processed for user `5ea5abd67bcb4818a5f601561039522d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:46.795589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a82475e0-f224-46dc-8f27-b5f175902648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:46.800965 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 799/1595] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.800965 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae6038-f084-49e9-8043-1ec6ce54e541 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.811115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae6038-f084-49e9-8043-1ec6ce54e541 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.815835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcfc1d-cf6d-42e3-af5a-ef5eb2eea755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.816585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcfc1d-cf6d-42e3-af5a-ef5eb2eea755 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.816943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcfc1d-cf6d-42e3-af5a-ef5eb2eea755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.817272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcfc1d-cf6d-42e3-af5a-ef5eb2eea755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.818190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcfc1d-cf6d-42e3-af5a-ef5eb2eea755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.819845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcfc1d-cf6d-42e3-af5a-ef5eb2eea755 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.831708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 800/1596] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.835853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcfc1d-cf6d-42e3-af5a-ef5eb2eea755 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.846143 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcfc1d-cf6d-42e3-af5a-ef5eb2eea755 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.852236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12bb69-673e-4564-9a88-8b4c5989e7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.853341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12bb69-673e-4564-9a88-8b4c5989e7c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.853907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12bb69-673e-4564-9a88-8b4c5989e7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.854457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12bb69-673e-4564-9a88-8b4c5989e7c6 admin admin] PATH_INFO: `/v3/projects/4a74defc69084b06b8d6300d1ce15bc5/users/bbb6c8f984d645dda88e2744f62a5213/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.868057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 797/1597] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:46.877095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12bb69-673e-4564-9a88-8b4c5989e7c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a74defc69084b06b8d6300d1ce15bc5, user_id=bbb6c8f984d645dda88e2744f62a5213, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.877557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82475e0-f224-46dc-8f27-b5f175902648 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.880770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12bb69-673e-4564-9a88-8b4c5989e7c6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.892307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82475e0-f224-46dc-8f27-b5f175902648 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.902100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 801/1598] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:46 2022] PUT /identity/v3/projects/4a74defc69084b06b8d6300d1ce15bc5/users/bbb6c8f984d645dda88e2744f62a5213/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:46.903942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12bb69-673e-4564-9a88-8b4c5989e7c6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.959855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd8a32-24f5-4fcc-ab3a-33f069e3f686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.960624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd8a32-24f5-4fcc-ab3a-33f069e3f686 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.960961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd8a32-24f5-4fcc-ab3a-33f069e3f686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.961713 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd8a32-24f5-4fcc-ab3a-33f069e3f686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:46.962134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd8a32-24f5-4fcc-ab3a-33f069e3f686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:46.963975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd8a32-24f5-4fcc-ab3a-33f069e3f686 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:46.978860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 798/1599] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:46.978860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd8a32-24f5-4fcc-ab3a-33f069e3f686 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:46.989121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd8a32-24f5-4fcc-ab3a-33f069e3f686 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:46.994295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b63057-8bb0-4f04-b083-d20bf1e4c4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:46.995279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b63057-8bb0-4f04-b083-d20bf1e4c4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:46.995630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b63057-8bb0-4f04-b083-d20bf1e4c4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:46.996037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b63057-8bb0-4f04-b083-d20bf1e4c4ce admin admin] PATH_INFO: `/v3/projects/1d8e7a5f85464feeb943b5da573f0844/users/e0b3c1b83e3f46a5a2d2593191f118ec/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.003279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12bb69-673e-4564-9a88-8b4c5989e7c6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.010606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42cbf1-2fc2-45f1-936a-559b2445169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.011917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42cbf1-2fc2-45f1-936a-559b2445169d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.012564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42cbf1-2fc2-45f1-936a-559b2445169d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.012948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42cbf1-2fc2-45f1-936a-559b2445169d admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.013822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42cbf1-2fc2-45f1-936a-559b2445169d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.014351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b63057-8bb0-4f04-b083-d20bf1e4c4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8e7a5f85464feeb943b5da573f0844, user_id=e0b3c1b83e3f46a5a2d2593191f118ec, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.015885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42cbf1-2fc2-45f1-936a-559b2445169d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.017579 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b63057-8bb0-4f04-b083-d20bf1e4c4ce admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.030282 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 802/1600] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:47.030981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42cbf1-2fc2-45f1-936a-559b2445169d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.041016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 799/1601] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:46 2022] PUT /identity/v3/projects/1d8e7a5f85464feeb943b5da573f0844/users/e0b3c1b83e3f46a5a2d2593191f118ec/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:47.042638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b63057-8bb0-4f04-b083-d20bf1e4c4ce admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.046968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42cbf1-2fc2-45f1-936a-559b2445169d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.074312 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:47.110490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea835182-a276-4b74-880e-40546dc09e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.111468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835182-a276-4b74-880e-40546dc09e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.111780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835182-a276-4b74-880e-40546dc09e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.112089 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea835182-a276-4b74-880e-40546dc09e3e admin admin] PATH_INFO: `/v3/projects/d45ebb59cbd44217ab1a912a4b5393ca/users/66df948e1af04ecd9fb9eb75e2b0478f/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.128078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b63057-8bb0-4f04-b083-d20bf1e4c4ce admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.132538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea835182-a276-4b74-880e-40546dc09e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45ebb59cbd44217ab1a912a4b5393ca, user_id=66df948e1af04ecd9fb9eb75e2b0478f, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.133284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb2ccb-9fb3-42b7-8293-6f0054508dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.134185 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb2ccb-9fb3-42b7-8293-6f0054508dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.134466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb2ccb-9fb3-42b7-8293-6f0054508dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.134739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb2ccb-9fb3-42b7-8293-6f0054508dca admin admin] PATH_INFO: `/v3/projects/d1f2c05ead494663a00e539b006654f2/users/4524a8c31517409b915723cce3140d0b/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.135942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea835182-a276-4b74-880e-40546dc09e3e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.151609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb2ccb-9fb3-42b7-8293-6f0054508dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f2c05ead494663a00e539b006654f2, user_id=4524a8c31517409b915723cce3140d0b, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.153351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 803/1602] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:47 2022] PUT /identity/v3/projects/d45ebb59cbd44217ab1a912a4b5393ca/users/66df948e1af04ecd9fb9eb75e2b0478f/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:47.154730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc858b97-8c4b-49d9-9e7a-ac608cc82ca5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.155048 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb2ccb-9fb3-42b7-8293-6f0054508dca admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.155257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc858b97-8c4b-49d9-9e7a-ac608cc82ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.155588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc858b97-8c4b-49d9-9e7a-ac608cc82ca5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.157239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 804/1603] 10.222.0.39 () {54 vars in 961 bytes} [Sat Jun 4 18:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:28:47.158237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d74a6d-9e0e-4cc4-8125-c8ecf09ea47d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.158618 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d74a6d-9e0e-4cc4-8125-c8ecf09ea47d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.158986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d74a6d-9e0e-4cc4-8125-c8ecf09ea47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.177966 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 800/1604] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:47 2022] PUT /identity/v3/projects/d1f2c05ead494663a00e539b006654f2/users/4524a8c31517409b915723cce3140d0b/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:47.178719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e1d74a6d-9e0e-4cc4-8125-c8ecf09ea47d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:47.178877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb2ccb-9fb3-42b7-8293-6f0054508dca admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.180088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e1d74a6d-9e0e-4cc4-8125-c8ecf09ea47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:47.190321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:47.240371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb2ccb-9fb3-42b7-8293-6f0054508dca admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.244909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd15227-ae93-444c-af40-78047efe7201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.245593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd15227-ae93-444c-af40-78047efe7201 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.245878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd15227-ae93-444c-af40-78047efe7201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.246157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd15227-ae93-444c-af40-78047efe7201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.246527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 805/1605] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:47.247341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d74a6d-9e0e-4cc4-8125-c8ecf09ea47d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.247600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd15227-ae93-444c-af40-78047efe7201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.249470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd15227-ae93-444c-af40-78047efe7201 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.259291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d74a6d-9e0e-4cc4-8125-c8ecf09ea47d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.263740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 801/1606] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:47.263740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04806b-4a0f-4e02-9021-db7deb4f897c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.263740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04806b-4a0f-4e02-9021-db7deb4f897c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.263740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04806b-4a0f-4e02-9021-db7deb4f897c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.265203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6617a-cd13-45a0-a033-b3be8c8558ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.266093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6617a-cd13-45a0-a033-b3be8c8558ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.266372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6617a-cd13-45a0-a033-b3be8c8558ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.266642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6617a-cd13-45a0-a033-b3be8c8558ef admin admin] PATH_INFO: `/v3/projects/a3c5011d10ed45c68dcfe77a09f6d9a1/users/30f3cc8f3f964b96b864fc8a7f86481a/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.280987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3a04806b-4a0f-4e02-9021-db7deb4f897c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:47.281181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6617a-cd13-45a0-a033-b3be8c8558ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c5011d10ed45c68dcfe77a09f6d9a1, user_id=30f3cc8f3f964b96b864fc8a7f86481a, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.282190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3a04806b-4a0f-4e02-9021-db7deb4f897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:47.284218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6617a-cd13-45a0-a033-b3be8c8558ef admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.289997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 802/1607] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:47.292071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb246-0eca-41a7-ace1-a141c55f8ebc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.292552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb246-0eca-41a7-ace1-a141c55f8ebc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.292835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb246-0eca-41a7-ace1-a141c55f8ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.307858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 806/1608] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:47 2022] PUT /identity/v3/projects/a3c5011d10ed45c68dcfe77a09f6d9a1/users/30f3cc8f3f964b96b864fc8a7f86481a/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:47.309401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f79e0-f521-4acd-9599-5db5fef39554 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.309766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f79e0-f521-4acd-9599-5db5fef39554 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.310048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f79e0-f521-4acd-9599-5db5fef39554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.315989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c91fb246-0eca-41a7-ace1-a141c55f8ebc None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:47.317224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c91fb246-0eca-41a7-ace1-a141c55f8ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:47.336975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f29f79e0-f521-4acd-9599-5db5fef39554 None None] MFA Rules not processed for user `66df948e1af04ecd9fb9eb75e2b0478f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:47.338301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f29f79e0-f521-4acd-9599-5db5fef39554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:47.385938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 803/1609] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Jun 4 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:47.387044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb76d4c-b3bb-4dc2-9dcf-a15c6b73cd81 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.387336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb76d4c-b3bb-4dc2-9dcf-a15c6b73cd81 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.387622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb76d4c-b3bb-4dc2-9dcf-a15c6b73cd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.407551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 807/1610] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:47.408168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f79e0-f521-4acd-9599-5db5fef39554 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.414707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8bb76d4c-b3bb-4dc2-9dcf-a15c6b73cd81 None None] MFA Rules not processed for user `4524a8c31517409b915723cce3140d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:47.416288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8bb76d4c-b3bb-4dc2-9dcf-a15c6b73cd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:47.429250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:47.463954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f79e0-f521-4acd-9599-5db5fef39554 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.467860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227370c0-8b9f-4c9a-83f0-deeabe204e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.468546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227370c0-8b9f-4c9a-83f0-deeabe204e75 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.468829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227370c0-8b9f-4c9a-83f0-deeabe204e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.469104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227370c0-8b9f-4c9a-83f0-deeabe204e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.484248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 804/1611] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:47.485693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb76d4c-b3bb-4dc2-9dcf-a15c6b73cd81 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.500536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:47.532504 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227370c0-8b9f-4c9a-83f0-deeabe204e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.533964 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227370c0-8b9f-4c9a-83f0-deeabe204e75 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.543837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 808/1612] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:47.544617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227370c0-8b9f-4c9a-83f0-deeabe204e75 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.548195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb76d4c-b3bb-4dc2-9dcf-a15c6b73cd81 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.552474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227370c0-8b9f-4c9a-83f0-deeabe204e75 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.553496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078b33e-e4c0-4de5-bcf1-36199a249960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.554362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b33e-e4c0-4de5-bcf1-36199a249960 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.554736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b33e-e4c0-4de5-bcf1-36199a249960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.555015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b33e-e4c0-4de5-bcf1-36199a249960 admin admin] PATH_INFO: `/v3/projects/e1647c99716f4b20abf41c4e4c3ec38a/users/6ea261ac820542ff8698af7a5cec8181/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.557425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837438d6-8595-42ae-b0af-bc2aeef8c4a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.558077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837438d6-8595-42ae-b0af-bc2aeef8c4a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.559064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837438d6-8595-42ae-b0af-bc2aeef8c4a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.559064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837438d6-8595-42ae-b0af-bc2aeef8c4a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.569798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837438d6-8595-42ae-b0af-bc2aeef8c4a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.571514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837438d6-8595-42ae-b0af-bc2aeef8c4a0 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.573113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078b33e-e4c0-4de5-bcf1-36199a249960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1647c99716f4b20abf41c4e4c3ec38a, user_id=6ea261ac820542ff8698af7a5cec8181, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.576303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078b33e-e4c0-4de5-bcf1-36199a249960 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.581955 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 809/1613] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:47.583397 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21441a4d-8528-4602-9c53-6febe461d31b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.583745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21441a4d-8528-4602-9c53-6febe461d31b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.584445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21441a4d-8528-4602-9c53-6febe461d31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.592737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 805/1614] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:47 2022] PUT /identity/v3/projects/e1647c99716f4b20abf41c4e4c3ec38a/users/6ea261ac820542ff8698af7a5cec8181/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:47.593853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078b33e-e4c0-4de5-bcf1-36199a249960 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.608679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-21441a4d-8528-4602-9c53-6febe461d31b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:47.610723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-21441a4d-8528-4602-9c53-6febe461d31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:47.687077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 810/1615] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:47.687999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21441a4d-8528-4602-9c53-6febe461d31b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.703352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21441a4d-8528-4602-9c53-6febe461d31b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.707893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078b33e-e4c0-4de5-bcf1-36199a249960 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.709512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ff060-b13b-42db-9db2-e7b0df35db1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.710332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ff060-b13b-42db-9db2-e7b0df35db1a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.710612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ff060-b13b-42db-9db2-e7b0df35db1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.710984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ff060-b13b-42db-9db2-e7b0df35db1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.711751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ff060-b13b-42db-9db2-e7b0df35db1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.713850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ff060-b13b-42db-9db2-e7b0df35db1a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.714393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab38fef-8bbf-4002-b8bb-01adbc6e4ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.715189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab38fef-8bbf-4002-b8bb-01adbc6e4ff9 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.715597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab38fef-8bbf-4002-b8bb-01adbc6e4ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.715943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab38fef-8bbf-4002-b8bb-01adbc6e4ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.749362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 811/1616] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:47 2022] POST /identity/v3/projects => generated 353 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:47.750814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ff060-b13b-42db-9db2-e7b0df35db1a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.757400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:47.797756 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab38fef-8bbf-4002-b8bb-01adbc6e4ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.800130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab38fef-8bbf-4002-b8bb-01adbc6e4ff9 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.810197 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 806/1617] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:47.811645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1823e-8055-4a32-a25a-df0dcd0472c2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.811992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1823e-8055-4a32-a25a-df0dcd0472c2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.812296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1823e-8055-4a32-a25a-df0dcd0472c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.833622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ff060-b13b-42db-9db2-e7b0df35db1a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.839753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e6bc3-6978-4e1f-8504-7106ed43b59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.840631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e6bc3-6978-4e1f-8504-7106ed43b59f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.841023 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e6bc3-6978-4e1f-8504-7106ed43b59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.841470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e6bc3-6978-4e1f-8504-7106ed43b59f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:47.842641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e6bc3-6978-4e1f-8504-7106ed43b59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:47.843220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-00f1823e-8055-4a32-a25a-df0dcd0472c2 None None] MFA Rules not processed for user `6ea261ac820542ff8698af7a5cec8181`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:47.844543 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-00f1823e-8055-4a32-a25a-df0dcd0472c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:47.844962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e6bc3-6978-4e1f-8504-7106ed43b59f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:47.879181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 812/1618] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:47 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:47.880360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e6bc3-6978-4e1f-8504-7106ed43b59f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.883548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-853e6bc3-6978-4e1f-8504-7106ed43b59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:47.921735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:47.926108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 807/1619] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:47.928667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1823e-8055-4a32-a25a-df0dcd0472c2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:47.944119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1823e-8055-4a32-a25a-df0dcd0472c2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.986738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e6bc3-6978-4e1f-8504-7106ed43b59f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:47.991418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621efbfb-23d8-4bad-8283-730a14181850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:47.992760 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621efbfb-23d8-4bad-8283-730a14181850 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:47.993048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621efbfb-23d8-4bad-8283-730a14181850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:47.993446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621efbfb-23d8-4bad-8283-730a14181850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.007062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ef086-228d-4979-8f77-c7f7b7b285d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.007813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ef086-228d-4979-8f77-c7f7b7b285d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.008256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ef086-228d-4979-8f77-c7f7b7b285d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.008632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ef086-228d-4979-8f77-c7f7b7b285d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.009561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ef086-228d-4979-8f77-c7f7b7b285d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.011654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ef086-228d-4979-8f77-c7f7b7b285d6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.041649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 808/1620] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:47 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:48.042893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ef086-228d-4979-8f77-c7f7b7b285d6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:48.057289 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ef086-228d-4979-8f77-c7f7b7b285d6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:48.070454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674ca5f-fc23-4cec-8c6c-ee0654e54a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.071471 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674ca5f-fc23-4cec-8c6c-ee0654e54a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.071759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674ca5f-fc23-4cec-8c6c-ee0654e54a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.072119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674ca5f-fc23-4cec-8c6c-ee0654e54a00 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.072878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674ca5f-fc23-4cec-8c6c-ee0654e54a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.075050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674ca5f-fc23-4cec-8c6c-ee0654e54a00 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.081269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621efbfb-23d8-4bad-8283-730a14181850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.084757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621efbfb-23d8-4bad-8283-730a14181850 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.100845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 813/1621] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:48.102441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158f82e-33f4-40c8-933a-e777dc8169f1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.102800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158f82e-33f4-40c8-933a-e777dc8169f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.103142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158f82e-33f4-40c8-933a-e777dc8169f1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.103632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 809/1622] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:48 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:48.104606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674ca5f-fc23-4cec-8c6c-ee0654e54a00 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:48.104874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 814/1623] 10.222.0.39 () {54 vars in 961 bytes} [Sat Jun 4 18:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:28:48.106318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ed13-18af-4a2a-828c-ce3da215794a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.106980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ed13-18af-4a2a-828c-ce3da215794a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.107325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ed13-18af-4a2a-828c-ce3da215794a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.110697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 815/1624] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 4 18:28:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:28:48.112085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ed13-18af-4a2a-828c-ce3da215794a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:48.124127 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674ca5f-fc23-4cec-8c6c-ee0654e54a00 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:48.130477 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95afc2-c1c3-45e7-a06d-6d640077a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.130691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609ed13-18af-4a2a-828c-ce3da215794a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:48.131233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95afc2-c1c3-45e7-a06d-6d640077a1ec admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.131599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95afc2-c1c3-45e7-a06d-6d640077a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.131962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95afc2-c1c3-45e7-a06d-6d640077a1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.132855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95afc2-c1c3-45e7-a06d-6d640077a1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.139191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95afc2-c1c3-45e7-a06d-6d640077a1ec admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.139612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f394101-bd59-4bd7-a72d-ab95d7a463cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.139612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f394101-bd59-4bd7-a72d-ab95d7a463cd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.139612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f394101-bd59-4bd7-a72d-ab95d7a463cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.140625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f394101-bd59-4bd7-a72d-ab95d7a463cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.141699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f394101-bd59-4bd7-a72d-ab95d7a463cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.143600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f394101-bd59-4bd7-a72d-ab95d7a463cd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.162181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 810/1625] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:48.163764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e5c8-c508-49b1-ab16-86d160fe63a0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.164066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e5c8-c508-49b1-ab16-86d160fe63a0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.164344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e5c8-c508-49b1-ab16-86d160fe63a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.179091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 816/1626] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:48.185347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb9580-f4fd-4397-a4ec-248252459bc3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.185843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb9580-f4fd-4397-a4ec-248252459bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.186678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb9580-f4fd-4397-a4ec-248252459bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.186905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8459e5c8-c508-49b1-ab16-86d160fe63a0 None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:48.188242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8459e5c8-c508-49b1-ab16-86d160fe63a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:48.217612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-eafb9580-f4fd-4397-a4ec-248252459bc3 None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:48.225339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eafb9580-f4fd-4397-a4ec-248252459bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:48.228752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:48.298848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 811/1627] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Jun 4 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:48.299746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459e5c8-c508-49b1-ab16-86d160fe63a0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:48.317840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459e5c8-c508-49b1-ab16-86d160fe63a0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:48.332081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127f150-14f8-4b4a-96de-cf47cfefa506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.332081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127f150-14f8-4b4a-96de-cf47cfefa506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.332081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127f150-14f8-4b4a-96de-cf47cfefa506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.332081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127f150-14f8-4b4a-96de-cf47cfefa506 admin admin] PATH_INFO: `/v3/projects/906685255a624281a8fcdd85b401e312/users/18c7357ac72d481b9f054510cd02abe5/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.354407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 817/1628] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:48.355579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb9580-f4fd-4397-a4ec-248252459bc3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:48.369456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127f150-14f8-4b4a-96de-cf47cfefa506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906685255a624281a8fcdd85b401e312, user_id=18c7357ac72d481b9f054510cd02abe5, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.369882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb9580-f4fd-4397-a4ec-248252459bc3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:48.372776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127f150-14f8-4b4a-96de-cf47cfefa506 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.376313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df374ce-ee8e-4fc3-8992-bc1b82814eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.377447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df374ce-ee8e-4fc3-8992-bc1b82814eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.377730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df374ce-ee8e-4fc3-8992-bc1b82814eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.378003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df374ce-ee8e-4fc3-8992-bc1b82814eb2 admin admin] PATH_INFO: `/v3/projects/5af0f304dce24a89b17bc7698ed7f315/users/b52d04ddd21c4b1fbe4c64584504e962/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.400219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 812/1629] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:48 2022] PUT /identity/v3/projects/906685255a624281a8fcdd85b401e312/users/18c7357ac72d481b9f054510cd02abe5/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:48.401423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127f150-14f8-4b4a-96de-cf47cfefa506 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:48.404548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df374ce-ee8e-4fc3-8992-bc1b82814eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af0f304dce24a89b17bc7698ed7f315, user_id=b52d04ddd21c4b1fbe4c64584504e962, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.407680 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df374ce-ee8e-4fc3-8992-bc1b82814eb2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.425317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 818/1630] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:48 2022] PUT /identity/v3/projects/5af0f304dce24a89b17bc7698ed7f315/users/b52d04ddd21c4b1fbe4c64584504e962/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:48.426684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df374ce-ee8e-4fc3-8992-bc1b82814eb2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:48.476992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:48.526353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df374ce-ee8e-4fc3-8992-bc1b82814eb2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:48.531046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6fa92-9551-4c38-ac23-817b564c7610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.532036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6fa92-9551-4c38-ac23-817b564c7610 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.532480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6fa92-9551-4c38-ac23-817b564c7610 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.532954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6fa92-9551-4c38-ac23-817b564c7610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.541581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127f150-14f8-4b4a-96de-cf47cfefa506 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:48.633609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6fa92-9551-4c38-ac23-817b564c7610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.636360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6fa92-9551-4c38-ac23-817b564c7610 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.650615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc018-8abb-416b-bc83-2f9fe1425eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.651541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc018-8abb-416b-bc83-2f9fe1425eea service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.651899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc018-8abb-416b-bc83-2f9fe1425eea service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.652306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc018-8abb-416b-bc83-2f9fe1425eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.653704 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 819/1631] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:48.654840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6fa92-9551-4c38-ac23-817b564c7610 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:48.701984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:48.782582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6fa92-9551-4c38-ac23-817b564c7610 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:48.796313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54373e4-0616-4b7c-acaf-5702452a2678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.796681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54373e4-0616-4b7c-acaf-5702452a2678 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.796968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54373e4-0616-4b7c-acaf-5702452a2678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.797290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54373e4-0616-4b7c-acaf-5702452a2678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.801371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54373e4-0616-4b7c-acaf-5702452a2678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.803199 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54373e4-0616-4b7c-acaf-5702452a2678 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.824432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc018-8abb-416b-bc83-2f9fe1425eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.828403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 820/1632] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:48.832975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc018-8abb-416b-bc83-2f9fe1425eea service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.834643 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54373e4-0616-4b7c-acaf-5702452a2678 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:48.855121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54373e4-0616-4b7c-acaf-5702452a2678 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:48.857635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 813/1633] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:48.870235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc018-8abb-416b-bc83-2f9fe1425eea service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:48.887353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ae59a-389f-40e2-9869-09dd6e070611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.889872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae59a-389f-40e2-9869-09dd6e070611 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.890145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae59a-389f-40e2-9869-09dd6e070611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.890422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae59a-389f-40e2-9869-09dd6e070611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.891173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ae59a-389f-40e2-9869-09dd6e070611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.902869 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ae59a-389f-40e2-9869-09dd6e070611 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:48.908251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc018-8abb-416b-bc83-2f9fe1425eea service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:48.937560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cbc29-56a7-4655-b62c-64c23be47c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:48.942204 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cbc29-56a7-4655-b62c-64c23be47c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.942490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cbc29-56a7-4655-b62c-64c23be47c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.942759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cbc29-56a7-4655-b62c-64c23be47c04 admin admin] PATH_INFO: `/v3/projects/906685255a624281a8fcdd85b401e312/users/18c7357ac72d481b9f054510cd02abe5/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.950281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 821/1634] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:48.953783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cbc29-56a7-4655-b62c-64c23be47c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906685255a624281a8fcdd85b401e312, user_id=18c7357ac72d481b9f054510cd02abe5, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:48.954493 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71f81c-87e4-4b7f-940b-e5eb834198b7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:48.954783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71f81c-87e4-4b7f-940b-e5eb834198b7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:48.957691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71f81c-87e4-4b7f-940b-e5eb834198b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:48.966742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cbc29-56a7-4655-b62c-64c23be47c04 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:49.015153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 814/1635] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:48 2022] PUT /identity/v3/projects/906685255a624281a8fcdd85b401e312/users/18c7357ac72d481b9f054510cd02abe5/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:49.037897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cbc29-56a7-4655-b62c-64c23be47c04 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:49.081002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dc71f81c-87e4-4b7f-940b-e5eb834198b7 None None] MFA Rules not processed for user `e0b3c1b83e3f46a5a2d2593191f118ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:49.082233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dc71f81c-87e4-4b7f-940b-e5eb834198b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:49.188760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cbc29-56a7-4655-b62c-64c23be47c04 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:49.198699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d9d18-b5d6-4880-8d80-afa3c406611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:49.199658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d9d18-b5d6-4880-8d80-afa3c406611b admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:49.203924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d9d18-b5d6-4880-8d80-afa3c406611b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:49.204233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d9d18-b5d6-4880-8d80-afa3c406611b admin admin] PATH_INFO: `/v3/projects/5af0f304dce24a89b17bc7698ed7f315/users/b52d04ddd21c4b1fbe4c64584504e962/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:49.207611 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d9d18-b5d6-4880-8d80-afa3c406611b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af0f304dce24a89b17bc7698ed7f315, user_id=b52d04ddd21c4b1fbe4c64584504e962, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:49.210372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:49.214751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d9d18-b5d6-4880-8d80-afa3c406611b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:49.246227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 815/1636] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:49 2022] PUT /identity/v3/projects/5af0f304dce24a89b17bc7698ed7f315/users/b52d04ddd21c4b1fbe4c64584504e962/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:49.247952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeff184-1220-41e5-b3af-467e55d09059 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:49.250888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeff184-1220-41e5-b3af-467e55d09059 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:49.251324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeff184-1220-41e5-b3af-467e55d09059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:49.270249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 822/1637] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:49.273722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090346e-c69c-4ae7-95f7-09d5725a1052 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:49.274029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090346e-c69c-4ae7-95f7-09d5725a1052 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:49.274357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090346e-c69c-4ae7-95f7-09d5725a1052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:49.339095 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-deeff184-1220-41e5-b3af-467e55d09059 None None] MFA Rules not processed for user `18c7357ac72d481b9f054510cd02abe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:49.341891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a090346e-c69c-4ae7-95f7-09d5725a1052 None None] MFA Rules not processed for user `b52d04ddd21c4b1fbe4c64584504e962`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:49.342330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-deeff184-1220-41e5-b3af-467e55d09059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:49.344053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a090346e-c69c-4ae7-95f7-09d5725a1052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:49.491712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 823/1638] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:49.498902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea310d31-54fa-46c2-96e2-539b15656231 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:49.499208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea310d31-54fa-46c2-96e2-539b15656231 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:49.501983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea310d31-54fa-46c2-96e2-539b15656231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:49.561035 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ea310d31-54fa-46c2-96e2-539b15656231 None None] MFA Rules not processed for user `e0b3c1b83e3f46a5a2d2593191f118ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:49.562503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ea310d31-54fa-46c2-96e2-539b15656231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:49.569058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 816/1639] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:49.569058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeff184-1220-41e5-b3af-467e55d09059 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:49.651332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:49.678131 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 824/1640] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:49.680426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac522df-6819-4f1d-bc01-7336819f8459 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:49.680949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac522df-6819-4f1d-bc01-7336819f8459 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:49.681469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac522df-6819-4f1d-bc01-7336819f8459 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:49.683634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 825/1641] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 4 18:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:28:49.684865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac522df-6819-4f1d-bc01-7336819f8459 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:49.709027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeff184-1220-41e5-b3af-467e55d09059 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:49.712900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33f635-5a57-4831-a237-3b47b6db9277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:49.713582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f635-5a57-4831-a237-3b47b6db9277 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:49.713866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f635-5a57-4831-a237-3b47b6db9277 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:49.714148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f635-5a57-4831-a237-3b47b6db9277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:49.725756 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33f635-5a57-4831-a237-3b47b6db9277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:49.727355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33f635-5a57-4831-a237-3b47b6db9277 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:49.739533 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 817/1642] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:49.752699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf68ec-7587-4692-ad6e-8a1dc23fc2e6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:49.752993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf68ec-7587-4692-ad6e-8a1dc23fc2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:49.757391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf68ec-7587-4692-ad6e-8a1dc23fc2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:49.805549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac522df-6819-4f1d-bc01-7336819f8459 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:49.809163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-95cf68ec-7587-4692-ad6e-8a1dc23fc2e6 None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:49.812145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-95cf68ec-7587-4692-ad6e-8a1dc23fc2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:49.812796 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdd207-08f7-4b4d-aee8-6e7b7f2d65ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:49.813688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdd207-08f7-4b4d-aee8-6e7b7f2d65ba service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:49.814259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdd207-08f7-4b4d-aee8-6e7b7f2d65ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:49.814637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdd207-08f7-4b4d-aee8-6e7b7f2d65ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:49.835432 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdd207-08f7-4b4d-aee8-6e7b7f2d65ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:49.837414 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdd207-08f7-4b4d-aee8-6e7b7f2d65ba service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:49.875475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 826/1643] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:49 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:49.998825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 818/1644] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:50.066947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdd207-08f7-4b4d-aee8-6e7b7f2d65ba service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:50.079132 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf68ec-7587-4692-ad6e-8a1dc23fc2e6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:50.090217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf68ec-7587-4692-ad6e-8a1dc23fc2e6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:50.092090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdd207-08f7-4b4d-aee8-6e7b7f2d65ba service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:50.112052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558a14d-9453-4615-815c-52e37c63bf85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:50.112547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa86c0-d845-4869-8a16-459c5fcba670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:50.112972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558a14d-9453-4615-815c-52e37c63bf85 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:50.113359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558a14d-9453-4615-815c-52e37c63bf85 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:50.113832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558a14d-9453-4615-815c-52e37c63bf85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:50.115424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa86c0-d845-4869-8a16-459c5fcba670 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:50.116567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa86c0-d845-4869-8a16-459c5fcba670 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:50.117545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa86c0-d845-4869-8a16-459c5fcba670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:50.129402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558a14d-9453-4615-815c-52e37c63bf85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:50.131948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558a14d-9453-4615-815c-52e37c63bf85 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:50.148129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:50.169563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 827/1645] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:50.170382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558a14d-9453-4615-815c-52e37c63bf85 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:50.192713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558a14d-9453-4615-815c-52e37c63bf85 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:50.206540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd27239-1544-4a36-964b-70129c4238fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:50.207320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27239-1544-4a36-964b-70129c4238fd service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:50.208190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27239-1544-4a36-964b-70129c4238fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:50.210000 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27239-1544-4a36-964b-70129c4238fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:50.231990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa86c0-d845-4869-8a16-459c5fcba670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:50.233619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa86c0-d845-4869-8a16-459c5fcba670 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:50.235671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd27239-1544-4a36-964b-70129c4238fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:50.237186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd27239-1544-4a36-964b-70129c4238fd service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:50.256557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 819/1646] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:28:50.282008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 828/1647] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:50.807445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa86c0-d845-4869-8a16-459c5fcba670 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:50.818902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa86c0-d845-4869-8a16-459c5fcba670 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:50.829469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916d6e7-ce74-48bf-b4ea-bfd2924d0b70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:50.830423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916d6e7-ce74-48bf-b4ea-bfd2924d0b70 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:50.830701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916d6e7-ce74-48bf-b4ea-bfd2924d0b70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:50.831081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916d6e7-ce74-48bf-b4ea-bfd2924d0b70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:50.878824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379167f-193a-49ff-815e-33f33cf09fe3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:50.879150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379167f-193a-49ff-815e-33f33cf09fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:50.879710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379167f-193a-49ff-815e-33f33cf09fe3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:50.881238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 829/1648] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 4 18:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:28:50.890830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1841d-4030-4451-98bf-3d58fe395c9e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:50.890830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1841d-4030-4451-98bf-3d58fe395c9e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:50.890830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1841d-4030-4451-98bf-3d58fe395c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:50.969659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916d6e7-ce74-48bf-b4ea-bfd2924d0b70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:50.973819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916d6e7-ce74-48bf-b4ea-bfd2924d0b70 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:50.975877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-33b1841d-4030-4451-98bf-3d58fe395c9e None None] MFA Rules not processed for user `37c4400204794a54957ccf28df938f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:50.980337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-33b1841d-4030-4451-98bf-3d58fe395c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:51.011802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 820/1649] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:50 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:51.150835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 830/1650] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:51.171638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916d6e7-ce74-48bf-b4ea-bfd2924d0b70 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:51.179753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:51.191075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916d6e7-ce74-48bf-b4ea-bfd2924d0b70 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:51.199975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164d5f8-7425-4f3d-8cd7-62c31c87a17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:51.200801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d5f8-7425-4f3d-8cd7-62c31c87a17c service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:51.202556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d5f8-7425-4f3d-8cd7-62c31c87a17c service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:51.204479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164d5f8-7425-4f3d-8cd7-62c31c87a17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:51.242357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164d5f8-7425-4f3d-8cd7-62c31c87a17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:51.246683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164d5f8-7425-4f3d-8cd7-62c31c87a17c service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:51.276574 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 821/1651] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:52.202050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572fe1b-03a2-4178-b0e3-d158cb2d79ae None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:52.209192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572fe1b-03a2-4178-b0e3-d158cb2d79ae None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:52.209728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572fe1b-03a2-4178-b0e3-d158cb2d79ae None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:52.212257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 831/1652] 10.222.0.39 () {54 vars in 960 bytes} [Sat Jun 4 18:28:52 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:28:52.225570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd3db-621a-4fb9-9240-9dff65475333 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:52.226460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd3db-621a-4fb9-9240-9dff65475333 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:52.226849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd3db-621a-4fb9-9240-9dff65475333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:52.253939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b8ebd3db-621a-4fb9-9240-9dff65475333 None None] MFA Rules not processed for user `9edcf71253ee4c81a402fffe13128b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:52.255761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b8ebd3db-621a-4fb9-9240-9dff65475333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:52.393413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 822/1653] 10.222.0.39 () {58 vars in 1057 bytes} [Sat Jun 4 18:28:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:52.401557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572fe1b-03a2-4178-b0e3-d158cb2d79ae None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:52.431922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572fe1b-03a2-4178-b0e3-d158cb2d79ae None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:52.457843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45ba73-32f1-4715-8890-b01c0019fb73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:52.461113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ba73-32f1-4715-8890-b01c0019fb73 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:52.462008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ba73-32f1-4715-8890-b01c0019fb73 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:52.462644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45ba73-32f1-4715-8890-b01c0019fb73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:52.466476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3e45ba73-32f1-4715-8890-b01c0019fb73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:52.500348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45ba73-32f1-4715-8890-b01c0019fb73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:52.503069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45ba73-32f1-4715-8890-b01c0019fb73 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:52.534926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 832/1654] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:53.176553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebd3db-621a-4fb9-9240-9dff65475333 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:53.436912 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebd3db-621a-4fb9-9240-9dff65475333 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:53.444438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:53.445316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:53.445729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:53.446122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] PATH_INFO: `/v3/users/5ea5abd67bcb4818a5f601561039522d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:53.447787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea5abd67bcb4818a5f601561039522d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:53.449746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:28:53.449746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 04 18:28:53.449746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: Jun 04 18:28:53.451531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:53.697410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea5abd67bcb4818a5f601561039522d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:53.766324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea5abd67bcb4818a5f601561039522d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:53.802648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea5abd67bcb4818a5f601561039522d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:53.819786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea5abd67bcb4818a5f601561039522d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:53.820975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea5abd67bcb4818a5f601561039522d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:53.838062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 823/1655] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:28:53 2022] DELETE /identity/v3/users/5ea5abd67bcb4818a5f601561039522d => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:53.844562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7d8c-e5d4-4dbc-a05e-13f5cf9689c1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:53.845465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7d8c-e5d4-4dbc-a05e-13f5cf9689c1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:53.846195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc7d8c-e5d4-4dbc-a05e-13f5cf9689c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:53.892936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-48dc7d8c-e5d4-4dbc-a05e-13f5cf9689c1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:53.899214 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-48dc7d8c-e5d4-4dbc-a05e-13f5cf9689c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:54.042952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 833/1656] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:54.070599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:54.072590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:54.098855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:54.278399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dda9a9-1706-46d5-b44b-6ae2fda0a3ab admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:54.298010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565abaeb-0410-49d8-80f5-c57aadd4b3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:54.298782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565abaeb-0410-49d8-80f5-c57aadd4b3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:54.299012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565abaeb-0410-49d8-80f5-c57aadd4b3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:54.299286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565abaeb-0410-49d8-80f5-c57aadd4b3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:54.340313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565abaeb-0410-49d8-80f5-c57aadd4b3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:54.342131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565abaeb-0410-49d8-80f5-c57aadd4b3e9 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:54.367928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 824/1657] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:55.148899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc7d8c-e5d4-4dbc-a05e-13f5cf9689c1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:55.150506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-48dc7d8c-e5d4-4dbc-a05e-13f5cf9689c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:55.172411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc7d8c-e5d4-4dbc-a05e-13f5cf9689c1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:55.181771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:55.185125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:55.185419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:55.185732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] PATH_INFO: `/v3/projects/9702c61600da49e29c12cbedfaf40308` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:55.188921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9702c61600da49e29c12cbedfaf40308)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:55.189868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 18:28:55.189868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 04 18:28:55.189868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: Jun 04 18:28:55.202508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:55.341098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9702c61600da49e29c12cbedfaf40308', 'request_id': 'req-28df8922-2470-4d23-915b-190855c7ff85'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:55.370510 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9702c61600da49e29c12cbedfaf40308', 'request_id': 'req-28df8922-2470-4d23-915b-190855c7ff85'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:55.409061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9702c61600da49e29c12cbedfaf40308', 'request_id': 'req-28df8922-2470-4d23-915b-190855c7ff85'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:55.426355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:55.435478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] The token cache is being invalidate because project 9702c61600da49e29c12cbedfaf40308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:28:55.436060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:55.436970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28df8922-2470-4d23-915b-190855c7ff85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:55.448431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ce67d-d85e-4571-a4a9-efe98cda35cf None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:55.448920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 834/1658] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:28:55 2022] DELETE /identity/v3/projects/9702c61600da49e29c12cbedfaf40308 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:55.449663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ce67d-d85e-4571-a4a9-efe98cda35cf None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:55.450140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ce67d-d85e-4571-a4a9-efe98cda35cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:55.473978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-627ce67d-d85e-4571-a4a9-efe98cda35cf None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:55.475615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-627ce67d-d85e-4571-a4a9-efe98cda35cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:55.565446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 825/1659] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:55.572945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413491-0a85-4425-8f1e-cde63e029511 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:55.573453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413491-0a85-4425-8f1e-cde63e029511 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:55.573900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413491-0a85-4425-8f1e-cde63e029511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:55.599112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c9413491-0a85-4425-8f1e-cde63e029511 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:55.600769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c9413491-0a85-4425-8f1e-cde63e029511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:55.615254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 835/1660] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:55.616579 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ce67d-d85e-4571-a4a9-efe98cda35cf None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:55.635615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ce67d-d85e-4571-a4a9-efe98cda35cf None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:55.641335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741a512-d334-4e76-8380-a0d3710ff10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:55.642445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741a512-d334-4e76-8380-a0d3710ff10a admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:55.642930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741a512-d334-4e76-8380-a0d3710ff10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:55.643401 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741a512-d334-4e76-8380-a0d3710ff10a admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:55.644388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741a512-d334-4e76-8380-a0d3710ff10a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:28:55.644894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741a512-d334-4e76-8380-a0d3710ff10a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:55.646823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741a512-d334-4e76-8380-a0d3710ff10a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:55.662012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 826/1661] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:28:55.667360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9413491-0a85-4425-8f1e-cde63e029511 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:55.679496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9413491-0a85-4425-8f1e-cde63e029511 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:55.685944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39224a-24b2-4ad0-9c16-a8712fbe4c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:55.686732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39224a-24b2-4ad0-9c16-a8712fbe4c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:55.686973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39224a-24b2-4ad0-9c16-a8712fbe4c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:55.687431 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39224a-24b2-4ad0-9c16-a8712fbe4c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:55.688806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39224a-24b2-4ad0-9c16-a8712fbe4c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:55.691553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39224a-24b2-4ad0-9c16-a8712fbe4c0a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:55.763535 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 836/1662] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:55 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:55.769070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741a512-d334-4e76-8380-a0d3710ff10a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:55.785218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741a512-d334-4e76-8380-a0d3710ff10a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:55.885129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf7546-a222-4426-ae63-da18d5319d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:55.886996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf7546-a222-4426-ae63-da18d5319d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:55.887564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf7546-a222-4426-ae63-da18d5319d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:55.888119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf7546-a222-4426-ae63-da18d5319d63 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:55.889992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf7546-a222-4426-ae63-da18d5319d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:55.893705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf7546-a222-4426-ae63-da18d5319d63 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:55.933665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 827/1663] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:55 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:55.934624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39224a-24b2-4ad0-9c16-a8712fbe4c0a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:55.953870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39224a-24b2-4ad0-9c16-a8712fbe4c0a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:55.961050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15307fc4-f21b-42d1-876d-ff78f56c8a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:55.963040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307fc4-f21b-42d1-876d-ff78f56c8a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:55.963589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307fc4-f21b-42d1-876d-ff78f56c8a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:55.964190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15307fc4-f21b-42d1-876d-ff78f56c8a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:55.965628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15307fc4-f21b-42d1-876d-ff78f56c8a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:55.969321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15307fc4-f21b-42d1-876d-ff78f56c8a38 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:56.021040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf7546-a222-4426-ae63-da18d5319d63 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:56.022241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 837/1664] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:56.039715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf7546-a222-4426-ae63-da18d5319d63 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:56.048871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b567b3-6d32-4ced-9858-f9ae7fefc034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:56.049728 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b567b3-6d32-4ced-9858-f9ae7fefc034 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:56.050019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b567b3-6d32-4ced-9858-f9ae7fefc034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:56.050299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b567b3-6d32-4ced-9858-f9ae7fefc034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:56.051067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b567b3-6d32-4ced-9858-f9ae7fefc034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:56.053017 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b567b3-6d32-4ced-9858-f9ae7fefc034 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:56.077491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15307fc4-f21b-42d1-876d-ff78f56c8a38 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:56.086865 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 828/1665] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:56.097254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15307fc4-f21b-42d1-876d-ff78f56c8a38 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:56.105495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5010cb-703d-462e-ae57-2e025da8bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:56.109844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5010cb-703d-462e-ae57-2e025da8bd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:56.110294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5010cb-703d-462e-ae57-2e025da8bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:56.111538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5010cb-703d-462e-ae57-2e025da8bd08 admin admin] PATH_INFO: `/v3/projects/ca7b778257c346e083645d41a3eb8732/users/0383457f6d3c4a89b75f724102c0039b/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:56.170216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5010cb-703d-462e-ae57-2e025da8bd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7b778257c346e083645d41a3eb8732, user_id=0383457f6d3c4a89b75f724102c0039b, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:56.174682 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5010cb-703d-462e-ae57-2e025da8bd08 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:56.211355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 838/1666] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:56 2022] PUT /identity/v3/projects/ca7b778257c346e083645d41a3eb8732/users/0383457f6d3c4a89b75f724102c0039b/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:28:56.225214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f9c9-2169-4890-9871-778bf1021867 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:56.226385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f9c9-2169-4890-9871-778bf1021867 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:56.227794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713f9c9-2169-4890-9871-778bf1021867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:56.307080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8713f9c9-2169-4890-9871-778bf1021867 None None] MFA Rules not processed for user `0383457f6d3c4a89b75f724102c0039b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:56.308341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8713f9c9-2169-4890-9871-778bf1021867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:56.313057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:56.399895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 829/1667] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:56.407972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5010cb-703d-462e-ae57-2e025da8bd08 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:56.409499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cc5010cb-703d-462e-ae57-2e025da8bd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:56.613405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5010cb-703d-462e-ae57-2e025da8bd08 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:56.627256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67964bd3-1d3e-446b-8ca7-b7b923222a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:56.628120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67964bd3-1d3e-446b-8ca7-b7b923222a71 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:56.628516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67964bd3-1d3e-446b-8ca7-b7b923222a71 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:56.628939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67964bd3-1d3e-446b-8ca7-b7b923222a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:56.651187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67964bd3-1d3e-446b-8ca7-b7b923222a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:56.654559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67964bd3-1d3e-446b-8ca7-b7b923222a71 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:56.678393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 839/1668] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:56.956163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f9c9-2169-4890-9871-778bf1021867 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:57.077032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713f9c9-2169-4890-9871-778bf1021867 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:57.088662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:57.089942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:57.090810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:57.091395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] PATH_INFO: `/v3/users/0383457f6d3c4a89b75f724102c0039b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:57.093567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0383457f6d3c4a89b75f724102c0039b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:57.097155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:57.186311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0383457f6d3c4a89b75f724102c0039b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:57.232597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0383457f6d3c4a89b75f724102c0039b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:57.256924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0383457f6d3c4a89b75f724102c0039b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:57.273694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0383457f6d3c4a89b75f724102c0039b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:57.275267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0383457f6d3c4a89b75f724102c0039b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:57.292826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 830/1669] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:28:56 2022] DELETE /identity/v3/users/0383457f6d3c4a89b75f724102c0039b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:57.298093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0694-af85-4e28-a1c6-0b6fab6864c7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:57.299027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0694-af85-4e28-a1c6-0b6fab6864c7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:57.299458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b0694-af85-4e28-a1c6-0b6fab6864c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:57.329337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-da5b0694-af85-4e28-a1c6-0b6fab6864c7 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:57.342779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da5b0694-af85-4e28-a1c6-0b6fab6864c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:57.462059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 840/1670] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:57.463242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:57.465022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:57.527811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:57.632522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14eb66-363c-49d2-ad30-4104d688f1b5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:57.642069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840ba7a-59bd-40d7-8305-ebb99b23154d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:57.642892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840ba7a-59bd-40d7-8305-ebb99b23154d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:57.643280 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840ba7a-59bd-40d7-8305-ebb99b23154d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:57.643661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840ba7a-59bd-40d7-8305-ebb99b23154d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:57.679390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840ba7a-59bd-40d7-8305-ebb99b23154d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:57.681388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840ba7a-59bd-40d7-8305-ebb99b23154d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:57.724214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 831/1671] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:58.151376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0694-af85-4e28-a1c6-0b6fab6864c7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:58.168317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da5b0694-af85-4e28-a1c6-0b6fab6864c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:58.206897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b0694-af85-4e28-a1c6-0b6fab6864c7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:58.216347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:58.217910 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:58.218189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:58.218460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] PATH_INFO: `/v3/projects/ca7b778257c346e083645d41a3eb8732` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:58.219778 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca7b778257c346e083645d41a3eb8732)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:58.221749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:58.234762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:58.289126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca7b778257c346e083645d41a3eb8732', 'request_id': 'req-981ad53c-167b-4d28-b865-a3012d6173db'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:58.303506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be473cd2-39b1-4c33-95e8-73022a7b1804 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:58.304432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be473cd2-39b1-4c33-95e8-73022a7b1804 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:58.304708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be473cd2-39b1-4c33-95e8-73022a7b1804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:58.326058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca7b778257c346e083645d41a3eb8732', 'request_id': 'req-981ad53c-167b-4d28-b865-a3012d6173db'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:58.333610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca7b778257c346e083645d41a3eb8732', 'request_id': 'req-981ad53c-167b-4d28-b865-a3012d6173db'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:58.347688 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-be473cd2-39b1-4c33-95e8-73022a7b1804 None None] MFA Rules not processed for user `bbb6c8f984d645dda88e2744f62a5213`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:58.348971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-be473cd2-39b1-4c33-95e8-73022a7b1804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:58.349347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] The token cache is being invalidate because project ca7b778257c346e083645d41a3eb8732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:28:58.350253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:58.351091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-981ad53c-167b-4d28-b865-a3012d6173db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:28:58.353109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 841/1672] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:28:58 2022] DELETE /identity/v3/projects/ca7b778257c346e083645d41a3eb8732 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:58.361382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e8e2-e379-4bec-9211-f7c5b8c247df None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:58.361671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e8e2-e379-4bec-9211-f7c5b8c247df None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:58.361946 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e8e2-e379-4bec-9211-f7c5b8c247df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:58.386780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a916e8e2-e379-4bec-9211-f7c5b8c247df None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:58.388259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a916e8e2-e379-4bec-9211-f7c5b8c247df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:58.477173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 842/1673] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:58.488187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee412dd-2fad-4df5-9d4b-e09ccdb8794c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:58.490520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee412dd-2fad-4df5-9d4b-e09ccdb8794c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:58.490891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee412dd-2fad-4df5-9d4b-e09ccdb8794c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:58.495332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 832/1674] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:28:58.510760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be473cd2-39b1-4c33-95e8-73022a7b1804 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:58.513648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-be473cd2-39b1-4c33-95e8-73022a7b1804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:58.541518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4ee412dd-2fad-4df5-9d4b-e09ccdb8794c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:58.542833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4ee412dd-2fad-4df5-9d4b-e09ccdb8794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:58.563116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 843/1675] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:58.568372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee412dd-2fad-4df5-9d4b-e09ccdb8794c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:58.578121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee412dd-2fad-4df5-9d4b-e09ccdb8794c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:58.587754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2056c0-55e5-40cb-97e2-223fe3f6cce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:58.588630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2056c0-55e5-40cb-97e2-223fe3f6cce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:58.588981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2056c0-55e5-40cb-97e2-223fe3f6cce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:58.589321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2056c0-55e5-40cb-97e2-223fe3f6cce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:58.590152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2056c0-55e5-40cb-97e2-223fe3f6cce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:28:58.590732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2056c0-55e5-40cb-97e2-223fe3f6cce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:58.592801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2056c0-55e5-40cb-97e2-223fe3f6cce0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:58.637126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 844/1676] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:28:58.639641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2056c0-55e5-40cb-97e2-223fe3f6cce0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:58.675769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2056c0-55e5-40cb-97e2-223fe3f6cce0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:58.676503 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be473cd2-39b1-4c33-95e8-73022a7b1804 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:58.686362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240dd63-5dfb-4bdd-917e-e777746edc68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:58.687056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240dd63-5dfb-4bdd-917e-e777746edc68 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:58.687361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240dd63-5dfb-4bdd-917e-e777746edc68 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:58.690785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240dd63-5dfb-4bdd-917e-e777746edc68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:58.700546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483ecee-0c9f-482a-bf68-7bbf1ceb456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:58.701667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483ecee-0c9f-482a-bf68-7bbf1ceb456e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:58.703085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483ecee-0c9f-482a-bf68-7bbf1ceb456e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:58.704763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483ecee-0c9f-482a-bf68-7bbf1ceb456e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:58.706270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483ecee-0c9f-482a-bf68-7bbf1ceb456e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:58.709229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240dd63-5dfb-4bdd-917e-e777746edc68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:58.710857 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240dd63-5dfb-4bdd-917e-e777746edc68 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:58.717878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483ecee-0c9f-482a-bf68-7bbf1ceb456e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:58.723527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 833/1677] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:28:58.818386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 845/1678] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:28:58 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:58.826744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240dd63-5dfb-4bdd-917e-e777746edc68 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:58.845126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f1d47-5218-43b6-8f58-ae214a155120 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:58.846820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f1d47-5218-43b6-8f58-ae214a155120 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:58.847677 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f1d47-5218-43b6-8f58-ae214a155120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:58.864778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240dd63-5dfb-4bdd-917e-e777746edc68 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:58.882843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e96f1d47-5218-43b6-8f58-ae214a155120 None None] MFA Rules not processed for user `30f3cc8f3f964b96b864fc8a7f86481a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:58.884312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e96f1d47-5218-43b6-8f58-ae214a155120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:58.990590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:59.010024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:28:59.045969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437f8a-6110-48c8-964e-df7c92422232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:59.047116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437f8a-6110-48c8-964e-df7c92422232 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:59.047495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437f8a-6110-48c8-964e-df7c92422232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:59.047950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437f8a-6110-48c8-964e-df7c92422232 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:59.048797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437f8a-6110-48c8-964e-df7c92422232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:59.050886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437f8a-6110-48c8-964e-df7c92422232 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:59.106411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 846/1679] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:59.106613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 834/1680] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:28:58 2022] POST /identity/v3/users => generated 303 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:28:59.106702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f1d47-5218-43b6-8f58-ae214a155120 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:59.110780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59526060-fa4b-4792-91ac-9e63d09ae104 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:59.111218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59526060-fa4b-4792-91ac-9e63d09ae104 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:59.111603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59526060-fa4b-4792-91ac-9e63d09ae104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:59.126286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f1d47-5218-43b6-8f58-ae214a155120 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:59.139553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06267dfe-c38b-4ec3-828b-5a3782ee1f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:59.140458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267dfe-c38b-4ec3-828b-5a3782ee1f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:59.140746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267dfe-c38b-4ec3-828b-5a3782ee1f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:59.141108 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267dfe-c38b-4ec3-828b-5a3782ee1f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:59.141861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06267dfe-c38b-4ec3-828b-5a3782ee1f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:59.143734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06267dfe-c38b-4ec3-828b-5a3782ee1f7e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:59.148875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-59526060-fa4b-4792-91ac-9e63d09ae104 None None] MFA Rules not processed for user `30f3cc8f3f964b96b864fc8a7f86481a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:59.152867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-59526060-fa4b-4792-91ac-9e63d09ae104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:59.172540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 835/1681] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:28:59.172697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 847/1682] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:59.174806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59526060-fa4b-4792-91ac-9e63d09ae104 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:59.184424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06267dfe-c38b-4ec3-828b-5a3782ee1f7e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:59.203886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59526060-fa4b-4792-91ac-9e63d09ae104 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:59.207121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8c5bb-d757-4708-b623-d0df8ccce2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:59.209070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8c5bb-d757-4708-b623-d0df8ccce2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:59.209461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8c5bb-d757-4708-b623-d0df8ccce2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:59.211030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8c5bb-d757-4708-b623-d0df8ccce2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:59.212392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8c5bb-d757-4708-b623-d0df8ccce2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:59.216229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8c5bb-d757-4708-b623-d0df8ccce2d0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:59.249487 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 836/1683] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:28:59.251130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8c5bb-d757-4708-b623-d0df8ccce2d0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:59.264944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8c5bb-d757-4708-b623-d0df8ccce2d0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:59.274243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29ec63-cdb1-485b-8c54-6a894c4c6b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:59.275322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ec63-cdb1-485b-8c54-6a894c4c6b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:59.278230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ec63-cdb1-485b-8c54-6a894c4c6b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:59.279753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ec63-cdb1-485b-8c54-6a894c4c6b2c admin admin] PATH_INFO: `/v3/projects/9d1031b1b68e40739cb4bc1c942b2ec3/users/b9ea398ff28e4cb584dc8edd4f984287/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:59.321170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29ec63-cdb1-485b-8c54-6a894c4c6b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1031b1b68e40739cb4bc1c942b2ec3, user_id=b9ea398ff28e4cb584dc8edd4f984287, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:59.324554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29ec63-cdb1-485b-8c54-6a894c4c6b2c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:59.352165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 837/1684] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:28:59 2022] PUT /identity/v3/projects/9d1031b1b68e40739cb4bc1c942b2ec3/users/b9ea398ff28e4cb584dc8edd4f984287/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:28:59.358089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826b9bd-9068-45c1-a2f1-73e2f6111749 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:59.358797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826b9bd-9068-45c1-a2f1-73e2f6111749 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:59.359243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826b9bd-9068-45c1-a2f1-73e2f6111749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:59.361171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06267dfe-c38b-4ec3-828b-5a3782ee1f7e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:59.382396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a826b9bd-9068-45c1-a2f1-73e2f6111749 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:28:59.385869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a826b9bd-9068-45c1-a2f1-73e2f6111749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:59.521960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126a7bb-70bf-496c-a8ac-7c383f711d13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:59.524816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126a7bb-70bf-496c-a8ac-7c383f711d13 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:59.525097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126a7bb-70bf-496c-a8ac-7c383f711d13 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:59.525371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126a7bb-70bf-496c-a8ac-7c383f711d13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:59.548148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 838/1685] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:28:59.554922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826b9bd-9068-45c1-a2f1-73e2f6111749 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:28:59.557013 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a826b9bd-9068-45c1-a2f1-73e2f6111749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:28:59.645612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826b9bd-9068-45c1-a2f1-73e2f6111749 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:28:59.646336 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126a7bb-70bf-496c-a8ac-7c383f711d13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:59.649084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126a7bb-70bf-496c-a8ac-7c383f711d13 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:59.650947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbe5ef-2326-4d6f-ab8f-bca027a7f3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:28:59.651626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbe5ef-2326-4d6f-ab8f-bca027a7f3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:28:59.651910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbe5ef-2326-4d6f-ab8f-bca027a7f3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:28:59.652213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbe5ef-2326-4d6f-ab8f-bca027a7f3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:28:59.664381 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 848/1686] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:28:59.670102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbe5ef-2326-4d6f-ab8f-bca027a7f3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:28:59.674517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbe5ef-2326-4d6f-ab8f-bca027a7f3c6 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:28:59.700503 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 839/1687] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:00.940096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65b8e-3714-4bf3-b018-feb289108462 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:00.940620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65b8e-3714-4bf3-b018-feb289108462 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:00.940792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65b8e-3714-4bf3-b018-feb289108462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:01.021577 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:01.043333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0bc65b8e-3714-4bf3-b018-feb289108462 None None] MFA Rules not processed for user `b9ea398ff28e4cb584dc8edd4f984287`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:01.045659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0bc65b8e-3714-4bf3-b018-feb289108462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:01.157150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbe5ef-2326-4d6f-ab8f-bca027a7f3c6 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:01.165061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 849/1688] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:01.171783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbe5ef-2326-4d6f-ab8f-bca027a7f3c6 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:01.183990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a67a7b-b1b2-4321-aebb-c17f5df4d514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:01.187725 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a67a7b-b1b2-4321-aebb-c17f5df4d514 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:01.188225 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a67a7b-b1b2-4321-aebb-c17f5df4d514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:01.188639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a67a7b-b1b2-4321-aebb-c17f5df4d514 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:01.190282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a67a7b-b1b2-4321-aebb-c17f5df4d514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:01.196748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a67a7b-b1b2-4321-aebb-c17f5df4d514 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:01.220943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6f73-dd7d-4b18-9cf1-c608f85d467c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:01.221235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6f73-dd7d-4b18-9cf1-c608f85d467c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:01.221511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb6f73-dd7d-4b18-9cf1-c608f85d467c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:01.293546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-aeeb6f73-dd7d-4b18-9cf1-c608f85d467c None None] MFA Rules not processed for user `30f3cc8f3f964b96b864fc8a7f86481a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:01.296248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aeeb6f73-dd7d-4b18-9cf1-c608f85d467c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:01.309130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 840/1689] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:01 2022] POST /identity/v3/projects => generated 405 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:01.312759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a67a7b-b1b2-4321-aebb-c17f5df4d514 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:01.355154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:01.419129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 850/1690] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:01.449394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a67a7b-b1b2-4321-aebb-c17f5df4d514 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:01.455078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9f2ac-1b1d-456e-8da3-47058d8a20d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:01.456710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f2ac-1b1d-456e-8da3-47058d8a20d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:01.456710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f2ac-1b1d-456e-8da3-47058d8a20d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:01.456710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9f2ac-1b1d-456e-8da3-47058d8a20d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:01.458168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9f2ac-1b1d-456e-8da3-47058d8a20d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:01.464682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9f2ac-1b1d-456e-8da3-47058d8a20d8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:01.504042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 841/1691] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:01 2022] POST /identity/v3/users => generated 309 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:01.508265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6f73-dd7d-4b18-9cf1-c608f85d467c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:01.538809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb6f73-dd7d-4b18-9cf1-c608f85d467c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:01.568326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2193d-f06c-4dfa-b9ed-f411ace3e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:01.569486 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2193d-f06c-4dfa-b9ed-f411ace3e500 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:01.569952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2193d-f06c-4dfa-b9ed-f411ace3e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:01.570644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2193d-f06c-4dfa-b9ed-f411ace3e500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:01.573360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2193d-f06c-4dfa-b9ed-f411ace3e500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:01.579559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2193d-f06c-4dfa-b9ed-f411ace3e500 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:01.625102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 851/1692] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:01.629153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9f2ac-1b1d-456e-8da3-47058d8a20d8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:01.656458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9f2ac-1b1d-456e-8da3-47058d8a20d8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:01.678790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c372f-3057-4c60-a040-26e18a1abd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:01.680570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c372f-3057-4c60-a040-26e18a1abd0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:01.681112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c372f-3057-4c60-a040-26e18a1abd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:01.681689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c372f-3057-4c60-a040-26e18a1abd0b admin admin] PATH_INFO: `/v3/projects/1c292fffdc734ab38152d25cb6d349e8/users/7a1a640d4bb049e59e565459572bee66/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:01.731399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c372f-3057-4c60-a040-26e18a1abd0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c292fffdc734ab38152d25cb6d349e8, user_id=7a1a640d4bb049e59e565459572bee66, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:01.740849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c372f-3057-4c60-a040-26e18a1abd0b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:01.780385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 842/1693] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:01 2022] PUT /identity/v3/projects/1c292fffdc734ab38152d25cb6d349e8/users/7a1a640d4bb049e59e565459572bee66/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:01.783718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2193d-f06c-4dfa-b9ed-f411ace3e500 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:01.800048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2193d-f06c-4dfa-b9ed-f411ace3e500 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:01.963860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5e24-debb-46a4-ba1f-dbdba918a97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:01.964798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5e24-debb-46a4-ba1f-dbdba918a97b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:01.965093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5e24-debb-46a4-ba1f-dbdba918a97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:01.965674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5e24-debb-46a4-ba1f-dbdba918a97b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:01.966104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5e24-debb-46a4-ba1f-dbdba918a97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:01.968622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5e24-debb-46a4-ba1f-dbdba918a97b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:01.998679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 852/1694] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:02.002930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c372f-3057-4c60-a040-26e18a1abd0b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:02.016482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c372f-3057-4c60-a040-26e18a1abd0b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:02.033146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f528ac2-228e-4fef-a99c-287def8de71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:02.034088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f528ac2-228e-4fef-a99c-287def8de71c admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:02.034369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f528ac2-228e-4fef-a99c-287def8de71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:02.034641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f528ac2-228e-4fef-a99c-287def8de71c admin admin] PATH_INFO: `/v3/projects/1c292fffdc734ab38152d25cb6d349e8/users/7a1a640d4bb049e59e565459572bee66/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:02.039834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f528ac2-228e-4fef-a99c-287def8de71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c292fffdc734ab38152d25cb6d349e8, user_id=7a1a640d4bb049e59e565459572bee66, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:02.042996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f528ac2-228e-4fef-a99c-287def8de71c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:02.084346 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 843/1695] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:02 2022] PUT /identity/v3/projects/1c292fffdc734ab38152d25cb6d349e8/users/7a1a640d4bb049e59e565459572bee66/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:02.147792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d25a9-4ba5-4cc9-9249-714f34eeab9d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:02.148482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d25a9-4ba5-4cc9-9249-714f34eeab9d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:02.148928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d25a9-4ba5-4cc9-9249-714f34eeab9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:02.164445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd305b74-dbab-4108-991a-e0493fa5e01a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:02.165635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd305b74-dbab-4108-991a-e0493fa5e01a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:02.166050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd305b74-dbab-4108-991a-e0493fa5e01a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:02.170025 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 844/1696] 10.222.0.39 () {54 vars in 912 bytes} [Sat Jun 4 18:29:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:29:02.190382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cee9e1-f99f-47ec-95df-6dc4c3b1e38d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:02.190871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cee9e1-f99f-47ec-95df-6dc4c3b1e38d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:02.191285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cee9e1-f99f-47ec-95df-6dc4c3b1e38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:02.241158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-051d25a9-4ba5-4cc9-9249-714f34eeab9d None None] MFA Rules not processed for user `bbb6c8f984d645dda88e2744f62a5213`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:02.243646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-051d25a9-4ba5-4cc9-9249-714f34eeab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:02.260616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-28cee9e1-f99f-47ec-95df-6dc4c3b1e38d None None] MFA Rules not processed for user `37c4400204794a54957ccf28df938f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:02.261908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-28cee9e1-f99f-47ec-95df-6dc4c3b1e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:02.439198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:02.530781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 845/1697] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:29:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:02.547969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cee9e1-f99f-47ec-95df-6dc4c3b1e38d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:02.548619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 853/1698] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:02.586825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cee9e1-f99f-47ec-95df-6dc4c3b1e38d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:02.606984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc36da-b494-4bf4-9e60-0215cbba0627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:02.607993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc36da-b494-4bf4-9e60-0215cbba0627 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:02.608470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc36da-b494-4bf4-9e60-0215cbba0627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:02.608909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc36da-b494-4bf4-9e60-0215cbba0627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:02.637663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc36da-b494-4bf4-9e60-0215cbba0627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:02.639777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc36da-b494-4bf4-9e60-0215cbba0627 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:02.687122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 846/1699] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:04.125029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c9b68-682e-42af-90cf-8a00e33acb29 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:04.125562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c9b68-682e-42af-90cf-8a00e33acb29 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:04.125562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c9b68-682e-42af-90cf-8a00e33acb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:04.181848 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-551c9b68-682e-42af-90cf-8a00e33acb29 None None] MFA Rules not processed for user `7a1a640d4bb049e59e565459572bee66`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:04.183364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-551c9b68-682e-42af-90cf-8a00e33acb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:04.334512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a7407-cb19-4217-a382-a7116d2fd571 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:04.335461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a7407-cb19-4217-a382-a7116d2fd571 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:04.336060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a7407-cb19-4217-a382-a7116d2fd571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:04.343055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 854/1700] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:04.357327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fa3a7407-cb19-4217-a382-a7116d2fd571 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:04.358969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fa3a7407-cb19-4217-a382-a7116d2fd571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:04.512613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 847/1701] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:29:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:04.865523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c9b68-682e-42af-90cf-8a00e33acb29 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:04.867489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-551c9b68-682e-42af-90cf-8a00e33acb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:05.135670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c9b68-682e-42af-90cf-8a00e33acb29 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:05.157950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908cd25-e4e4-45cf-838f-22705581a23c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:05.158656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908cd25-e4e4-45cf-838f-22705581a23c service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:05.158940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908cd25-e4e4-45cf-838f-22705581a23c service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:05.159335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908cd25-e4e4-45cf-838f-22705581a23c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:05.211659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908cd25-e4e4-45cf-838f-22705581a23c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:05.217158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908cd25-e4e4-45cf-838f-22705581a23c service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:05.255770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 855/1702] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:29:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:29:06.749159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a7407-cb19-4217-a382-a7116d2fd571 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:06.759382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fa3a7407-cb19-4217-a382-a7116d2fd571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:06.790624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:06.986940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a7407-cb19-4217-a382-a7116d2fd571 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:06.999737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:07.001054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:07.002041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:07.002766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] PATH_INFO: `/v3/users/6ea261ac820542ff8698af7a5cec8181` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:07.004511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea261ac820542ff8698af7a5cec8181)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:07.008554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:07.113784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea261ac820542ff8698af7a5cec8181'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:07.137628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea261ac820542ff8698af7a5cec8181'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:07.161540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea261ac820542ff8698af7a5cec8181'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:07.189249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea261ac820542ff8698af7a5cec8181'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:07.190050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ebcea12d-d212-4a16-b1ae-70972020c44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea261ac820542ff8698af7a5cec8181'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:07.203372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 848/1703] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:06 2022] DELETE /identity/v3/users/6ea261ac820542ff8698af7a5cec8181 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:07.209747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd460c-e19e-4e75-8a8e-a1ef02983fe7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:07.211010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd460c-e19e-4e75-8a8e-a1ef02983fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:07.211559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd460c-e19e-4e75-8a8e-a1ef02983fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:07.251472 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9edd460c-e19e-4e75-8a8e-a1ef02983fe7 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:07.255388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9edd460c-e19e-4e75-8a8e-a1ef02983fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:07.420163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5650950-c3d1-41a6-a42b-9b3e00fa9e12 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:07.420262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5650950-c3d1-41a6-a42b-9b3e00fa9e12 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:07.421459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5650950-c3d1-41a6-a42b-9b3e00fa9e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:07.467086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:07.500881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f5650950-c3d1-41a6-a42b-9b3e00fa9e12 None None] MFA Rules not processed for user `37c4400204794a54957ccf28df938f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:07.508642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f5650950-c3d1-41a6-a42b-9b3e00fa9e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:07.536690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 856/1704] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:07.556771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321a720-f1ad-47c9-b074-15f8e7533d75 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:07.557248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321a720-f1ad-47c9-b074-15f8e7533d75 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:07.557472 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321a720-f1ad-47c9-b074-15f8e7533d75 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:07.558872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 857/1705] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 18:29:07.576935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321a720-f1ad-47c9-b074-15f8e7533d75 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:07.579464 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7321a720-f1ad-47c9-b074-15f8e7533d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:07.679771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321a720-f1ad-47c9-b074-15f8e7533d75 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:07.684064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a3f8-27d1-4656-99f7-506c25962740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:07.684765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a3f8-27d1-4656-99f7-506c25962740 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:07.685050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a3f8-27d1-4656-99f7-506c25962740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:07.685370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a3f8-27d1-4656-99f7-506c25962740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:07.697607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192a3f8-27d1-4656-99f7-506c25962740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:07.699149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192a3f8-27d1-4656-99f7-506c25962740 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:07.711758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 858/1706] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:07.713897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e649c08-f6de-4230-953e-6c5a50113430 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:07.714166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e649c08-f6de-4230-953e-6c5a50113430 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:07.714449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e649c08-f6de-4230-953e-6c5a50113430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:07.722997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 849/1707] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Jun 4 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:07.757502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9e649c08-f6de-4230-953e-6c5a50113430 None None] MFA Rules not processed for user `9edcf71253ee4c81a402fffe13128b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:07.759293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9e649c08-f6de-4230-953e-6c5a50113430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:07.873875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 859/1708] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:07.891888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5650950-c3d1-41a6-a42b-9b3e00fa9e12 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:07.893515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f5650950-c3d1-41a6-a42b-9b3e00fa9e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:07.948930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5650950-c3d1-41a6-a42b-9b3e00fa9e12 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:07.962712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0942b7-ffc3-491c-92fa-2652a6c91dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:07.980954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0942b7-ffc3-491c-92fa-2652a6c91dcf service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:07.981505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e649c08-f6de-4230-953e-6c5a50113430 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:07.982473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0942b7-ffc3-491c-92fa-2652a6c91dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:07.983881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9e649c08-f6de-4230-953e-6c5a50113430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:07.984586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0942b7-ffc3-491c-92fa-2652a6c91dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:08.005706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0942b7-ffc3-491c-92fa-2652a6c91dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:08.009056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0942b7-ffc3-491c-92fa-2652a6c91dcf service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:08.024189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 850/1709] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:08.040773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e649c08-f6de-4230-953e-6c5a50113430 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:08.057513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03916a0e-db17-41b2-be38-4032ea2e9d9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:08.058492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03916a0e-db17-41b2-be38-4032ea2e9d9a service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:08.058808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03916a0e-db17-41b2-be38-4032ea2e9d9a service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:08.059070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03916a0e-db17-41b2-be38-4032ea2e9d9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:08.068908 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03916a0e-db17-41b2-be38-4032ea2e9d9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:08.070533 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03916a0e-db17-41b2-be38-4032ea2e9d9a service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:08.081942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 860/1710] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:08.121898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0942b7-ffc3-491c-92fa-2652a6c91dcf service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:08.123756 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9a0942b7-ffc3-491c-92fa-2652a6c91dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:08.143282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0942b7-ffc3-491c-92fa-2652a6c91dcf service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:08.156607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:08.157561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:08.157850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:08.158129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] PATH_INFO: `/v3/users/f3c5fd8875524227a887d2cb5a268a44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:08.159497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c5fd8875524227a887d2cb5a268a44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:08.165383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:08.213720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:08.270397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c5fd8875524227a887d2cb5a268a44'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:08.292380 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c5fd8875524227a887d2cb5a268a44'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:08.310911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c5fd8875524227a887d2cb5a268a44'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:08.325296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c5fd8875524227a887d2cb5a268a44'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:08.326536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c5fd8875524227a887d2cb5a268a44'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:08.340148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 851/1711] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:08 2022] DELETE /identity/v3/users/f3c5fd8875524227a887d2cb5a268a44 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:08.342765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fdd5d-6d23-44f0-a6ed-2df759272a11 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:08.343387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fdd5d-6d23-44f0-a6ed-2df759272a11 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:08.343795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fdd5d-6d23-44f0-a6ed-2df759272a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:08.367681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ec1fdd5d-6d23-44f0-a6ed-2df759272a11 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:08.369224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ec1fdd5d-6d23-44f0-a6ed-2df759272a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:08.505863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 861/1712] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:08.535656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:08.538055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:08.639479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7898d61-035d-4116-a9b2-dd06601de1ac admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:08.653163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cf47f-e773-49bb-948c-621393a4fac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:08.654980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cf47f-e773-49bb-948c-621393a4fac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:08.656430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cf47f-e773-49bb-948c-621393a4fac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:08.656867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cf47f-e773-49bb-948c-621393a4fac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:08.693634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cf47f-e773-49bb-948c-621393a4fac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:08.697850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cf47f-e773-49bb-948c-621393a4fac2 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:08.735142 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 852/1713] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:10.404864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fdd5d-6d23-44f0-a6ed-2df759272a11 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:10.406476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ec1fdd5d-6d23-44f0-a6ed-2df759272a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:10.430362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fdd5d-6d23-44f0-a6ed-2df759272a11 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:10.438520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:10.439691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:10.439987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:10.440452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] PATH_INFO: `/v3/projects/e1647c99716f4b20abf41c4e4c3ec38a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:10.446091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1647c99716f4b20abf41c4e4c3ec38a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:10.451024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:10.473060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:10.547017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1647c99716f4b20abf41c4e4c3ec38a', 'request_id': 'req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:10.563190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1647c99716f4b20abf41c4e4c3ec38a', 'request_id': 'req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:10.573149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1647c99716f4b20abf41c4e4c3ec38a', 'request_id': 'req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:10.588059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] The token cache is being invalidate because project e1647c99716f4b20abf41c4e4c3ec38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:10.589737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:10.590911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d2a049de-7bb5-41cf-a061-9a644ba8bbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:10.597453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 862/1714] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:10 2022] DELETE /identity/v3/projects/e1647c99716f4b20abf41c4e4c3ec38a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:10.598540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae0aae-57dc-4253-8871-1ab4dc9b029d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:10.599021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae0aae-57dc-4253-8871-1ab4dc9b029d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:10.599115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae0aae-57dc-4253-8871-1ab4dc9b029d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:10.623353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e7ae0aae-57dc-4253-8871-1ab4dc9b029d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:10.636370 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e7ae0aae-57dc-4253-8871-1ab4dc9b029d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:10.853274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 853/1715] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:10.874775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5779-d655-4789-94ae-c5b6ee2147f5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:10.877215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5779-d655-4789-94ae-c5b6ee2147f5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:10.877502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5779-d655-4789-94ae-c5b6ee2147f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:10.915340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-68eb5779-d655-4789-94ae-c5b6ee2147f5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:10.916746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-68eb5779-d655-4789-94ae-c5b6ee2147f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:10.945142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 863/1716] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:10.969699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae0aae-57dc-4253-8871-1ab4dc9b029d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:10.986633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae0aae-57dc-4253-8871-1ab4dc9b029d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:11.001304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b05f91-963e-433c-a08f-8b0fdeda152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:11.002025 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b05f91-963e-433c-a08f-8b0fdeda152f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.002312 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b05f91-963e-433c-a08f-8b0fdeda152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.002582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b05f91-963e-433c-a08f-8b0fdeda152f admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.003333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b05f91-963e-433c-a08f-8b0fdeda152f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:11.003644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b05f91-963e-433c-a08f-8b0fdeda152f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:11.005333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b05f91-963e-433c-a08f-8b0fdeda152f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:11.044070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 854/1717] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:11.046779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb5779-d655-4789-94ae-c5b6ee2147f5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:11.063364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb5779-d655-4789-94ae-c5b6ee2147f5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:11.069180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab156e58-4f96-4552-9b2f-60dd2955e646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:11.069976 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab156e58-4f96-4552-9b2f-60dd2955e646 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.070357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab156e58-4f96-4552-9b2f-60dd2955e646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.070731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab156e58-4f96-4552-9b2f-60dd2955e646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.071648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab156e58-4f96-4552-9b2f-60dd2955e646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:11.073605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab156e58-4f96-4552-9b2f-60dd2955e646 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:11.077757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac774e5f-8293-4be8-a307-237899c9b3c7 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.078504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac774e5f-8293-4be8-a307-237899c9b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.078614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac774e5f-8293-4be8-a307-237899c9b3c7 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.080087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 855/1718] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:29:11.120604 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 864/1719] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:11 2022] POST /identity/v3/projects => generated 403 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:11.125581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac774e5f-8293-4be8-a307-237899c9b3c7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:11.146064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c1647-1a7d-4d6c-b387-1ac7079c36f0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.147598 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c1647-1a7d-4d6c-b387-1ac7079c36f0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.148257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c1647-1a7d-4d6c-b387-1ac7079c36f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.205678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3e3c1647-1a7d-4d6c-b387-1ac7079c36f0 None None] MFA Rules not processed for user `9edcf71253ee4c81a402fffe13128b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:11.207530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3e3c1647-1a7d-4d6c-b387-1ac7079c36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:11.255504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:11.355100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac774e5f-8293-4be8-a307-237899c9b3c7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:11.370441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217ca5b-03bd-434c-ab86-95c6134e71a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:11.372900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217ca5b-03bd-434c-ab86-95c6134e71a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.374634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217ca5b-03bd-434c-ab86-95c6134e71a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.377396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217ca5b-03bd-434c-ab86-95c6134e71a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.381085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217ca5b-03bd-434c-ab86-95c6134e71a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:11.388291 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217ca5b-03bd-434c-ab86-95c6134e71a9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:11.395942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 865/1720] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:11.434554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 856/1721] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:11 2022] POST /identity/v3/users => generated 302 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:11.440326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c1647-1a7d-4d6c-b387-1ac7079c36f0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:11.447112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217ca5b-03bd-434c-ab86-95c6134e71a9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:11.450890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2217ca5b-03bd-434c-ab86-95c6134e71a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:11.477715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c1647-1a7d-4d6c-b387-1ac7079c36f0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:11.492686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c3210-bf8b-4e3c-8de6-13d1dd644919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:11.493631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c3210-bf8b-4e3c-8de6-13d1dd644919 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.494077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c3210-bf8b-4e3c-8de6-13d1dd644919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.494503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c3210-bf8b-4e3c-8de6-13d1dd644919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.495459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c3210-bf8b-4e3c-8de6-13d1dd644919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:11.502752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217ca5b-03bd-434c-ab86-95c6134e71a9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:11.503747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c3210-bf8b-4e3c-8de6-13d1dd644919 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:11.519251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3899d9-b48a-48a9-9d10-d12fb20555f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:11.522340 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3899d9-b48a-48a9-9d10-d12fb20555f6 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.524729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3899d9-b48a-48a9-9d10-d12fb20555f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.530777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3899d9-b48a-48a9-9d10-d12fb20555f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.531053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 866/1722] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:11.531053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c3210-bf8b-4e3c-8de6-13d1dd644919 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:11.535748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-015c3210-bf8b-4e3c-8de6-13d1dd644919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:11.565724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c3210-bf8b-4e3c-8de6-13d1dd644919 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:11.570480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3899d9-b48a-48a9-9d10-d12fb20555f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:11.574647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3899d9-b48a-48a9-9d10-d12fb20555f6 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:11.579335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:11.580643 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.580928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.583869 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] PATH_INFO: `/v3/users/b9ea398ff28e4cb584dc8edd4f984287` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.589681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ea398ff28e4cb584dc8edd4f984287)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:11.591724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:11.625529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 857/1723] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:11.629899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3899d9-b48a-48a9-9d10-d12fb20555f6 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:11.657683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3899d9-b48a-48a9-9d10-d12fb20555f6 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:11.664796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a9506-bdb8-4908-908f-62724be49ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:11.666214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a9506-bdb8-4908-908f-62724be49ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.666638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a9506-bdb8-4908-908f-62724be49ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.666928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a9506-bdb8-4908-908f-62724be49ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.668452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a9506-bdb8-4908-908f-62724be49ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:11.670783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a9506-bdb8-4908-908f-62724be49ed5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:11.690576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 858/1724] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:11.699886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a9506-bdb8-4908-908f-62724be49ed5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:11.724545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ea398ff28e4cb584dc8edd4f984287'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:11.725388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ea398ff28e4cb584dc8edd4f984287'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:11.732923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:11.737690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a9506-bdb8-4908-908f-62724be49ed5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:11.754518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a778d-5940-4638-9735-1fb82ad1c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:11.755540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a778d-5940-4638-9735-1fb82ad1c704 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.755753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ea398ff28e4cb584dc8edd4f984287'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:11.755950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a778d-5940-4638-9735-1fb82ad1c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.756359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a778d-5940-4638-9735-1fb82ad1c704 admin admin] PATH_INFO: `/v3/projects/233da9472517491d8a5b0ba81d264d7b/users/ffcaad3af1a7409391b2fc0718fcf91d/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.756705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ea398ff28e4cb584dc8edd4f984287'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:11.771466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9afb6e0-17b6-4f91-9c0e-21c2dd9eae10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ea398ff28e4cb584dc8edd4f984287'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:11.798150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a778d-5940-4638-9735-1fb82ad1c704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=233da9472517491d8a5b0ba81d264d7b, user_id=ffcaad3af1a7409391b2fc0718fcf91d, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:11.823088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a778d-5940-4638-9735-1fb82ad1c704 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:11.828218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 867/1725] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:11 2022] DELETE /identity/v3/users/b9ea398ff28e4cb584dc8edd4f984287 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:11.887340 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 859/1726] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:11 2022] PUT /identity/v3/projects/233da9472517491d8a5b0ba81d264d7b/users/ffcaad3af1a7409391b2fc0718fcf91d/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:11.897348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac60be-f1a6-4726-9174-cd2b268feb85 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:11.897643 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac60be-f1a6-4726-9174-cd2b268feb85 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:11.897925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac60be-f1a6-4726-9174-cd2b268feb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:11.944388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a778d-5940-4638-9735-1fb82ad1c704 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:11.946337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-170a778d-5940-4638-9735-1fb82ad1c704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:11.978839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d7ac60be-f1a6-4726-9174-cd2b268feb85 None None] MFA Rules not processed for user `ffcaad3af1a7409391b2fc0718fcf91d`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:11.985112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d7ac60be-f1a6-4726-9174-cd2b268feb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:12.147769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a778d-5940-4638-9735-1fb82ad1c704 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:12.161539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:12.162889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:12.163196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:12.163520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] PATH_INFO: `/v3/projects/92f0edfa8c0349a695483cbc9bf73937` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:12.165442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f0edfa8c0349a695483cbc9bf73937)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:12.167660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:12.218749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 868/1727] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:12.221782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b86ef4-a524-4ce3-a977-d31401a1fcfe None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:12.223074 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b86ef4-a524-4ce3-a977-d31401a1fcfe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:12.225026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b86ef4-a524-4ce3-a977-d31401a1fcfe None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:12.226897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 869/1728] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:29:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:29:12.228995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b86ef4-a524-4ce3-a977-d31401a1fcfe None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:12.233595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d1b86ef4-a524-4ce3-a977-d31401a1fcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:12.257470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f0edfa8c0349a695483cbc9bf73937', 'request_id': 'req-68e14179-2bbe-46f9-bace-0ca3eea1e43c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:12.271502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f0edfa8c0349a695483cbc9bf73937', 'request_id': 'req-68e14179-2bbe-46f9-bace-0ca3eea1e43c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:12.287266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f0edfa8c0349a695483cbc9bf73937', 'request_id': 'req-68e14179-2bbe-46f9-bace-0ca3eea1e43c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:12.297018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:12.314583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] The token cache is being invalidate because project 92f0edfa8c0349a695483cbc9bf73937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:12.314987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:12.318108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68e14179-2bbe-46f9-bace-0ca3eea1e43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:12.322512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 860/1729] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:11 2022] DELETE /identity/v3/projects/92f0edfa8c0349a695483cbc9bf73937 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:12.324522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f398694-d78c-41a6-ad22-94208da47a49 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:12.325055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f398694-d78c-41a6-ad22-94208da47a49 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:12.325521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f398694-d78c-41a6-ad22-94208da47a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:12.388899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0f398694-d78c-41a6-ad22-94208da47a49 None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:12.390903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0f398694-d78c-41a6-ad22-94208da47a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:12.461359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b86ef4-a524-4ce3-a977-d31401a1fcfe None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:12.487041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24b65c-ce7d-412d-84af-e68c768f64d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:12.490862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24b65c-ce7d-412d-84af-e68c768f64d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:12.492286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24b65c-ce7d-412d-84af-e68c768f64d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:12.495669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24b65c-ce7d-412d-84af-e68c768f64d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:12.501321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24b65c-ce7d-412d-84af-e68c768f64d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:12.506612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24b65c-ce7d-412d-84af-e68c768f64d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:12.536717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 861/1730] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:12.548086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02182-d5e0-415c-a1d8-5c8341d525b2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:12.548086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02182-d5e0-415c-a1d8-5c8341d525b2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:12.552560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02182-d5e0-415c-a1d8-5c8341d525b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:12.626365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 870/1731] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:12 2022] POST /identity/v3/projects => generated 405 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:12.631745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24b65c-ce7d-412d-84af-e68c768f64d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:12.634566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4c24b65c-ce7d-412d-84af-e68c768f64d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:12.655719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-25d02182-d5e0-415c-a1d8-5c8341d525b2 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:12.657006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-25d02182-d5e0-415c-a1d8-5c8341d525b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:12.830673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:12.888582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24b65c-ce7d-412d-84af-e68c768f64d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:12.910159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f70be-4141-4662-a2c4-5ccdb3e08aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:12.911230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f70be-4141-4662-a2c4-5ccdb3e08aae admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:12.911678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f70be-4141-4662-a2c4-5ccdb3e08aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:12.912080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f70be-4141-4662-a2c4-5ccdb3e08aae admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:12.912919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f70be-4141-4662-a2c4-5ccdb3e08aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:12.915409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f70be-4141-4662-a2c4-5ccdb3e08aae admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:12.920437 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 862/1732] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:12.922003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedcc19-46a9-4c1d-8ad7-3a756e5da8d0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:12.922303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedcc19-46a9-4c1d-8ad7-3a756e5da8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:12.922649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedcc19-46a9-4c1d-8ad7-3a756e5da8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:12.975820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 871/1733] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:12 2022] POST /identity/v3/users => generated 309 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:12.977656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f70be-4141-4662-a2c4-5ccdb3e08aae admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:13.011316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f70be-4141-4662-a2c4-5ccdb3e08aae admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:13.023996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e479b-9dbc-4df3-aa4c-0b339b7069c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:13.025255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5cedcc19-46a9-4c1d-8ad7-3a756e5da8d0 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:13.026737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e479b-9dbc-4df3-aa4c-0b339b7069c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:13.027703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e479b-9dbc-4df3-aa4c-0b339b7069c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:13.029290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e479b-9dbc-4df3-aa4c-0b339b7069c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:13.029691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5cedcc19-46a9-4c1d-8ad7-3a756e5da8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:13.031317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e479b-9dbc-4df3-aa4c-0b339b7069c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:13.036715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e479b-9dbc-4df3-aa4c-0b339b7069c4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:13.060939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 863/1734] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:13.066055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedcc19-46a9-4c1d-8ad7-3a756e5da8d0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:13.071935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 872/1735] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:13.074740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e479b-9dbc-4df3-aa4c-0b339b7069c4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:13.092938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedcc19-46a9-4c1d-8ad7-3a756e5da8d0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:13.106322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794597a-4aa0-46bf-926a-55e0a8ea5032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:13.108804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794597a-4aa0-46bf-926a-55e0a8ea5032 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:13.109548 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794597a-4aa0-46bf-926a-55e0a8ea5032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:13.110110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794597a-4aa0-46bf-926a-55e0a8ea5032 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:13.110725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e479b-9dbc-4df3-aa4c-0b339b7069c4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:13.110936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794597a-4aa0-46bf-926a-55e0a8ea5032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:13.111248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794597a-4aa0-46bf-926a-55e0a8ea5032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:13.115246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794597a-4aa0-46bf-926a-55e0a8ea5032 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:13.126195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c091cfe-dca1-4f4f-bb99-c4b191257e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:13.130220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091cfe-dca1-4f4f-bb99-c4b191257e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:13.133180 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091cfe-dca1-4f4f-bb99-c4b191257e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:13.133770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091cfe-dca1-4f4f-bb99-c4b191257e90 admin admin] PATH_INFO: `/v3/projects/61fdf3d3bffe4c33989c6dd22a350f39/users/8b2cf8806c0b42238cc8bf8bbac14e30/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:13.143045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 864/1736] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:13.144623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794597a-4aa0-46bf-926a-55e0a8ea5032 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:13.160227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794597a-4aa0-46bf-926a-55e0a8ea5032 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:13.179773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c091cfe-dca1-4f4f-bb99-c4b191257e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61fdf3d3bffe4c33989c6dd22a350f39, user_id=8b2cf8806c0b42238cc8bf8bbac14e30, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:13.189217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c091cfe-dca1-4f4f-bb99-c4b191257e90 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:13.193530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42a77-d95c-41bf-83fb-b26955a42709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:13.193530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42a77-d95c-41bf-83fb-b26955a42709 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:13.193825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42a77-d95c-41bf-83fb-b26955a42709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:13.193902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a42a77-d95c-41bf-83fb-b26955a42709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:13.194649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a42a77-d95c-41bf-83fb-b26955a42709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:13.198040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a42a77-d95c-41bf-83fb-b26955a42709 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:13.238824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 873/1737] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:13 2022] PUT /identity/v3/projects/61fdf3d3bffe4c33989c6dd22a350f39/users/8b2cf8806c0b42238cc8bf8bbac14e30/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:13.242985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c091cfe-dca1-4f4f-bb99-c4b191257e90 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:13.279847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 865/1738] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:13 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:13.281492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42a77-d95c-41bf-83fb-b26955a42709 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:13.292749 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-78a42a77-d95c-41bf-83fb-b26955a42709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:13.451546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c091cfe-dca1-4f4f-bb99-c4b191257e90 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:13.481528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:13.535080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509a705-f302-4476-ba0b-260e389733eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:13.535985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509a705-f302-4476-ba0b-260e389733eb admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:13.536467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509a705-f302-4476-ba0b-260e389733eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:13.536856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509a705-f302-4476-ba0b-260e389733eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:13.537816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509a705-f302-4476-ba0b-260e389733eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:13.539674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509a705-f302-4476-ba0b-260e389733eb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:13.552351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 874/1739] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:13.553798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509a705-f302-4476-ba0b-260e389733eb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:13.567289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509a705-f302-4476-ba0b-260e389733eb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:13.578162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab74801-8c82-4351-9bd3-6ef8fa1282b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:13.579742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab74801-8c82-4351-9bd3-6ef8fa1282b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:13.580380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab74801-8c82-4351-9bd3-6ef8fa1282b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:13.580988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab74801-8c82-4351-9bd3-6ef8fa1282b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:13.582358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab74801-8c82-4351-9bd3-6ef8fa1282b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:13.586804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab74801-8c82-4351-9bd3-6ef8fa1282b5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:13.618014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a42a77-d95c-41bf-83fb-b26955a42709 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:13.629362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 875/1740] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:13 2022] POST /identity/v3/users => generated 290 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:13.631671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab74801-8c82-4351-9bd3-6ef8fa1282b5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:13.664152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02a412-9c4d-497f-8f26-27fd0d3a44ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:13.666320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02a412-9c4d-497f-8f26-27fd0d3a44ff service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:13.667017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab74801-8c82-4351-9bd3-6ef8fa1282b5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:13.674730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02a412-9c4d-497f-8f26-27fd0d3a44ff service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:13.675179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02a412-9c4d-497f-8f26-27fd0d3a44ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:13.681326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41631456-6934-471d-89d0-95ec412bc6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:13.685194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41631456-6934-471d-89d0-95ec412bc6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:13.685669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41631456-6934-471d-89d0-95ec412bc6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:13.687536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41631456-6934-471d-89d0-95ec412bc6ed admin admin] PATH_INFO: `/v3/projects/61fdf3d3bffe4c33989c6dd22a350f39/users/8b2cf8806c0b42238cc8bf8bbac14e30/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:13.692340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41631456-6934-471d-89d0-95ec412bc6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=61fdf3d3bffe4c33989c6dd22a350f39, user_id=8b2cf8806c0b42238cc8bf8bbac14e30, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:13.700878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41631456-6934-471d-89d0-95ec412bc6ed admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:13.710842 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02a412-9c4d-497f-8f26-27fd0d3a44ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:13.720569 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02a412-9c4d-497f-8f26-27fd0d3a44ff service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:13.741282 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 876/1741] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:13 2022] PUT /identity/v3/projects/61fdf3d3bffe4c33989c6dd22a350f39/users/8b2cf8806c0b42238cc8bf8bbac14e30/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:13.742694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41631456-6934-471d-89d0-95ec412bc6ed admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:13.781864 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 866/1742] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:13.784684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:13.784958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0227ce3-e8bc-470a-81fc-7630182bba7a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:13.785277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0227ce3-e8bc-470a-81fc-7630182bba7a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:13.787444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0227ce3-e8bc-470a-81fc-7630182bba7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:13.884631 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d0227ce3-e8bc-470a-81fc-7630182bba7a None None] MFA Rules not processed for user `8b2cf8806c0b42238cc8bf8bbac14e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:13.886105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d0227ce3-e8bc-470a-81fc-7630182bba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:13.991620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41631456-6934-471d-89d0-95ec412bc6ed admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:14.015433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3322823-fdd5-43fe-9dcc-78214d649542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:14.019927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3322823-fdd5-43fe-9dcc-78214d649542 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:14.020290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3322823-fdd5-43fe-9dcc-78214d649542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:14.020576 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3322823-fdd5-43fe-9dcc-78214d649542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:14.021366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3322823-fdd5-43fe-9dcc-78214d649542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:14.023117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3322823-fdd5-43fe-9dcc-78214d649542 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:14.066582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 867/1743] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:14.073481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0227ce3-e8bc-470a-81fc-7630182bba7a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:14.076584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 877/1744] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:14.077591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3322823-fdd5-43fe-9dcc-78214d649542 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:14.078553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d0227ce3-e8bc-470a-81fc-7630182bba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:14.104360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0227ce3-e8bc-470a-81fc-7630182bba7a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:14.111891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3322823-fdd5-43fe-9dcc-78214d649542 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:14.114000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:14.116138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:14.117431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:14.117769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] PATH_INFO: `/v3/projects/9d1031b1b68e40739cb4bc1c942b2ec3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:14.119808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1031b1b68e40739cb4bc1c942b2ec3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:14.122829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:14.134819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e265b-d064-421a-a99a-e5bd19b30bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:14.135933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e265b-d064-421a-a99a-e5bd19b30bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:14.137179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e265b-d064-421a-a99a-e5bd19b30bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:14.138883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e265b-d064-421a-a99a-e5bd19b30bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:14.139988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e265b-d064-421a-a99a-e5bd19b30bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:14.143467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e265b-d064-421a-a99a-e5bd19b30bf8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:14.179471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 878/1745] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:14.187923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e265b-d064-421a-a99a-e5bd19b30bf8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:14.192373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ae1e265b-d064-421a-a99a-e5bd19b30bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:14.264810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1031b1b68e40739cb4bc1c942b2ec3', 'request_id': 'req-ad78fb35-2ae2-4170-b6a2-5086884f07c8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:14.281642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1031b1b68e40739cb4bc1c942b2ec3', 'request_id': 'req-ad78fb35-2ae2-4170-b6a2-5086884f07c8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:14.314106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1031b1b68e40739cb4bc1c942b2ec3', 'request_id': 'req-ad78fb35-2ae2-4170-b6a2-5086884f07c8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:14.373332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e265b-d064-421a-a99a-e5bd19b30bf8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:14.375977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] The token cache is being invalidate because project 9d1031b1b68e40739cb4bc1c942b2ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:14.376407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:14.378345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:14.388941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 868/1746] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:14 2022] DELETE /identity/v3/projects/9d1031b1b68e40739cb4bc1c942b2ec3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:14.388941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:14.390038 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:14.452616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b5ca7-4c78-46ca-9756-d61a21d65647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:14.453366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5ca7-4c78-46ca-9756-d61a21d65647 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:14.454270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5ca7-4c78-46ca-9756-d61a21d65647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:14.454270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5ca7-4c78-46ca-9756-d61a21d65647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:14.456979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5b5b5ca7-4c78-46ca-9756-d61a21d65647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:14.502104 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:14.558410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78fb35-2ae2-4170-b6a2-5086884f07c8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:14.577430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0e51b-592d-4d36-92b4-29a70f35fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:14.578368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e51b-592d-4d36-92b4-29a70f35fcde admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:14.578656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e51b-592d-4d36-92b4-29a70f35fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:14.578929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0e51b-592d-4d36-92b4-29a70f35fcde admin admin] PATH_INFO: `/v3/projects/d29e240831784706b328cb1d4e975515/users/faadc409545b40eabdb986e952589a38/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:14.581045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b5ca7-4c78-46ca-9756-d61a21d65647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:14.582661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b5ca7-4c78-46ca-9756-d61a21d65647 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:14.620801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0e51b-592d-4d36-92b4-29a70f35fcde admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29e240831784706b328cb1d4e975515, user_id=faadc409545b40eabdb986e952589a38, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:14.621245 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 879/1747] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:14 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:14.622437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b5ca7-4c78-46ca-9756-d61a21d65647 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:14.623591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0e51b-592d-4d36-92b4-29a70f35fcde admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:14.627040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5b5b5ca7-4c78-46ca-9756-d61a21d65647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:14.653070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:14.663693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b5ca7-4c78-46ca-9756-d61a21d65647 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:14.673980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 869/1748] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:14 2022] PUT /identity/v3/projects/d29e240831784706b328cb1d4e975515/users/faadc409545b40eabdb986e952589a38/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:14.675554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6531d-f64c-4369-ade9-6567253b33eb None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:14.675854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6531d-f64c-4369-ade9-6567253b33eb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:14.676752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6531d-f64c-4369-ade9-6567253b33eb None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:14.678455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 870/1749] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:29:14.679652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8768d9a-7e4c-44b6-9f05-bd97b4877ffe None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:14.679940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8768d9a-7e4c-44b6-9f05-bd97b4877ffe None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:14.680242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8768d9a-7e4c-44b6-9f05-bd97b4877ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:14.748607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b8768d9a-7e4c-44b6-9f05-bd97b4877ffe None None] MFA Rules not processed for user `faadc409545b40eabdb986e952589a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:14.752881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b8768d9a-7e4c-44b6-9f05-bd97b4877ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:14.824838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:14.825807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:14.826212 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:14.826493 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] PATH_INFO: `/v3/users/7a1a640d4bb049e59e565459572bee66` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:14.829155 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1a640d4bb049e59e565459572bee66)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:14.829945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:14.936514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1a640d4bb049e59e565459572bee66'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:14.937396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1a640d4bb049e59e565459572bee66'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:14.961409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1a640d4bb049e59e565459572bee66'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:14.962096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1a640d4bb049e59e565459572bee66'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:14.977974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1a640d4bb049e59e565459572bee66'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:14.991324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 871/1750] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:14.992939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc233-f7cd-4e3d-8353-c7ba91a96e45 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:14.998556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc233-f7cd-4e3d-8353-c7ba91a96e45 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:14.998922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc233-f7cd-4e3d-8353-c7ba91a96e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:15.021610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 880/1751] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:14 2022] DELETE /identity/v3/users/7a1a640d4bb049e59e565459572bee66 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:15.021610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:15.023443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:15.039130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-25dbc233-f7cd-4e3d-8353-c7ba91a96e45 None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:15.040747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-25dbc233-f7cd-4e3d-8353-c7ba91a96e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:15.251993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199c72-2eb4-43f2-8b72-71831f30b5fb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:15.276088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:15.279215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:15.282363 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:15.287401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] PATH_INFO: `/v3/users/ffcaad3af1a7409391b2fc0718fcf91d` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:15.288842 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffcaad3af1a7409391b2fc0718fcf91d)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:15.296474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 872/1752] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:29:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:15.297551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbc233-f7cd-4e3d-8353-c7ba91a96e45 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:15.304827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-25dbc233-f7cd-4e3d-8353-c7ba91a96e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:15.310538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:15.343227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbc233-f7cd-4e3d-8353-c7ba91a96e45 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:15.354896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bb6f2-9eb6-4555-8021-8587417cf30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:15.356070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bb6f2-9eb6-4555-8021-8587417cf30b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:15.356438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bb6f2-9eb6-4555-8021-8587417cf30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:15.356777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bb6f2-9eb6-4555-8021-8587417cf30b admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:15.357574 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bb6f2-9eb6-4555-8021-8587417cf30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:15.358775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:15.361135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bb6f2-9eb6-4555-8021-8587417cf30b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:15.404392 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffcaad3af1a7409391b2fc0718fcf91d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:15.406043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffcaad3af1a7409391b2fc0718fcf91d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:15.425886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 873/1753] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:15 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:15.427010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bb6f2-9eb6-4555-8021-8587417cf30b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:15.428847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f94bb6f2-9eb6-4555-8021-8587417cf30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:15.444937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffcaad3af1a7409391b2fc0718fcf91d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:15.445695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffcaad3af1a7409391b2fc0718fcf91d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:15.462858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffcaad3af1a7409391b2fc0718fcf91d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:15.471191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:15.485765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 881/1754] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:15 2022] DELETE /identity/v3/users/ffcaad3af1a7409391b2fc0718fcf91d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:15.485961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:15.491248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:15.644974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bb6f2-9eb6-4555-8021-8587417cf30b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:15.646429 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9eb74-eac9-4a60-be0a-296b16fae405 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:15.661528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ae10f-7248-48d6-9713-c06f597f3158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:15.662378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ae10f-7248-48d6-9713-c06f597f3158 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:15.662674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ae10f-7248-48d6-9713-c06f597f3158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:15.663007 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ae10f-7248-48d6-9713-c06f597f3158 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:15.663814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ae10f-7248-48d6-9713-c06f597f3158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:15.666405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ae10f-7248-48d6-9713-c06f597f3158 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:15.707014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 882/1755] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:15 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:15.711622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9725-d346-46af-b73e-c897f194dec0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:15.712038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9725-d346-46af-b73e-c897f194dec0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:15.712412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9725-d346-46af-b73e-c897f194dec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:15.755241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dbfb9725-d346-46af-b73e-c897f194dec0 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:15.756321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dbfb9725-d346-46af-b73e-c897f194dec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:15.783098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 883/1756] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:15.783098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb9725-d346-46af-b73e-c897f194dec0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:15.800345 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb9725-d346-46af-b73e-c897f194dec0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:15.813708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16cac4-d267-437b-a5e6-a83dffce3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:15.814406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16cac4-d267-437b-a5e6-a83dffce3985 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:15.814785 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16cac4-d267-437b-a5e6-a83dffce3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:15.815119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16cac4-d267-437b-a5e6-a83dffce3985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:15.815862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16cac4-d267-437b-a5e6-a83dffce3985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:15.817532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16cac4-d267-437b-a5e6-a83dffce3985 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:15.843039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 884/1757] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:15.844233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16cac4-d267-437b-a5e6-a83dffce3985 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:15.847290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2e16cac4-d267-437b-a5e6-a83dffce3985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:15.866147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260b926-4ec8-4268-9eb3-2a9d39cd213e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:15.867490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260b926-4ec8-4268-9eb3-2a9d39cd213e service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:15.867490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260b926-4ec8-4268-9eb3-2a9d39cd213e service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:15.867490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260b926-4ec8-4268-9eb3-2a9d39cd213e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:15.870665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c260b926-4ec8-4268-9eb3-2a9d39cd213e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:15.930229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260b926-4ec8-4268-9eb3-2a9d39cd213e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:15.931944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260b926-4ec8-4268-9eb3-2a9d39cd213e service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:15.974044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 874/1758] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:15.989683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260b926-4ec8-4268-9eb3-2a9d39cd213e service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:16.035529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260b926-4ec8-4268-9eb3-2a9d39cd213e service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:16.053926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023e4ad-0b81-4f70-9e07-123096403028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:16.055405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023e4ad-0b81-4f70-9e07-123096403028 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:16.056950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023e4ad-0b81-4f70-9e07-123096403028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:16.057464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023e4ad-0b81-4f70-9e07-123096403028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:16.058228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023e4ad-0b81-4f70-9e07-123096403028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:16.065634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023e4ad-0b81-4f70-9e07-123096403028 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:16.086986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16cac4-d267-437b-a5e6-a83dffce3985 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:16.095538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 875/1759] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:16.096584 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023e4ad-0b81-4f70-9e07-123096403028 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:16.105329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ec861-d300-4f38-bace-a67f3b4cf2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:16.107023 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec861-d300-4f38-bace-a67f3b4cf2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:16.107778 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec861-d300-4f38-bace-a67f3b4cf2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:16.109729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1023e4ad-0b81-4f70-9e07-123096403028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:16.110603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec861-d300-4f38-bace-a67f3b4cf2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:16.132592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023e4ad-0b81-4f70-9e07-123096403028 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:16.139436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ec861-d300-4f38-bace-a67f3b4cf2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:16.142781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ec861-d300-4f38-bace-a67f3b4cf2b5 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:16.166139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:16.167386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:16.167845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:16.168302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] PATH_INFO: `/v3/projects/1c292fffdc734ab38152d25cb6d349e8` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:16.170152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c292fffdc734ab38152d25cb6d349e8)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:16.172617 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:16.198141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 885/1760] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:16.199016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ec861-d300-4f38-bace-a67f3b4cf2b5 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:16.231805 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ec861-d300-4f38-bace-a67f3b4cf2b5 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:16.251093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571af142-cd9a-47f6-89da-13e214d6afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:16.252575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571af142-cd9a-47f6-89da-13e214d6afa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:16.253034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571af142-cd9a-47f6-89da-13e214d6afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:16.253357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571af142-cd9a-47f6-89da-13e214d6afa4 admin admin] PATH_INFO: `/v3/projects/4b0fea725a42422da437a1dba5ff216f/users/f6fdedb3e25a44998febb2906f705367/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:16.314570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:16.320714 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571af142-cd9a-47f6-89da-13e214d6afa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0fea725a42422da437a1dba5ff216f, user_id=f6fdedb3e25a44998febb2906f705367, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:16.332248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571af142-cd9a-47f6-89da-13e214d6afa4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:16.345299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c292fffdc734ab38152d25cb6d349e8', 'request_id': 'req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:16.364282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c292fffdc734ab38152d25cb6d349e8', 'request_id': 'req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:16.364282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c292fffdc734ab38152d25cb6d349e8', 'request_id': 'req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:16.382806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 886/1761] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:16 2022] PUT /identity/v3/projects/4b0fea725a42422da437a1dba5ff216f/users/f6fdedb3e25a44998febb2906f705367/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:16.386673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc5f6f-05cc-4adc-91f7-f77811c1107b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:16.386673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc5f6f-05cc-4adc-91f7-f77811c1107b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:16.386939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc5f6f-05cc-4adc-91f7-f77811c1107b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:16.414677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] The token cache is being invalidate because project 1c292fffdc734ab38152d25cb6d349e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:16.416749 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:16.418129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8e2c753c-998f-4e39-9d4d-a754cc0f10b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:16.423039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 876/1762] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:16 2022] DELETE /identity/v3/projects/1c292fffdc734ab38152d25cb6d349e8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:16.431538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4bba5-adfa-4fe9-b5b0-5d50f44da76a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:16.432233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4bba5-adfa-4fe9-b5b0-5d50f44da76a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:16.432443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4bba5-adfa-4fe9-b5b0-5d50f44da76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:16.485950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2dfc5f6f-05cc-4adc-91f7-f77811c1107b None None] MFA Rules not processed for user `f6fdedb3e25a44998febb2906f705367`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:16.490519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2dfc5f6f-05cc-4adc-91f7-f77811c1107b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:16.512844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-92d4bba5-adfa-4fe9-b5b0-5d50f44da76a None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:16.514153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-92d4bba5-adfa-4fe9-b5b0-5d50f44da76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:16.560639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:16.666603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 887/1763] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:16.669113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc5f6f-05cc-4adc-91f7-f77811c1107b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:16.676228 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2dfc5f6f-05cc-4adc-91f7-f77811c1107b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:16.688398 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 877/1764] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:16.696823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305efd4a-5b28-4a77-8dda-2f9a0a214d0e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:16.697411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305efd4a-5b28-4a77-8dda-2f9a0a214d0e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:16.697804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305efd4a-5b28-4a77-8dda-2f9a0a214d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:16.723779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc5f6f-05cc-4adc-91f7-f77811c1107b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:16.738628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39520db6-6275-4215-aa20-28c184045dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:16.739488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520db6-6275-4215-aa20-28c184045dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:16.739870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520db6-6275-4215-aa20-28c184045dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:16.741060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520db6-6275-4215-aa20-28c184045dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:16.743266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39520db6-6275-4215-aa20-28c184045dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:16.747223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39520db6-6275-4215-aa20-28c184045dbf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:16.759084 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-305efd4a-5b28-4a77-8dda-2f9a0a214d0e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:16.765328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-305efd4a-5b28-4a77-8dda-2f9a0a214d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:16.811530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 878/1765] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:16.815615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305efd4a-5b28-4a77-8dda-2f9a0a214d0e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:16.859708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 888/1766] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:16 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:16.860045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305efd4a-5b28-4a77-8dda-2f9a0a214d0e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:16.863615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39520db6-6275-4215-aa20-28c184045dbf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.033524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39520db6-6275-4215-aa20-28c184045dbf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.043155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cd245-ffad-435f-843e-aabbd04e8389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.044729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cd245-ffad-435f-843e-aabbd04e8389 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.045171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cd245-ffad-435f-843e-aabbd04e8389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.046108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cd245-ffad-435f-843e-aabbd04e8389 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.047554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cd245-ffad-435f-843e-aabbd04e8389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:17.048086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cd245-ffad-435f-843e-aabbd04e8389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.049618 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d84f3f-b088-420e-bf60-4903e48c9a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.050265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cd245-ffad-435f-843e-aabbd04e8389 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.050421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d84f3f-b088-420e-bf60-4903e48c9a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.050568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d84f3f-b088-420e-bf60-4903e48c9a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.050881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d84f3f-b088-420e-bf60-4903e48c9a61 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.051582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d84f3f-b088-420e-bf60-4903e48c9a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.053569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d84f3f-b088-420e-bf60-4903e48c9a61 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.094871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 879/1767] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:17.100117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cd245-ffad-435f-843e-aabbd04e8389 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.108226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 889/1768] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:16 2022] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:17.109413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d84f3f-b088-420e-bf60-4903e48c9a61 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.128202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cd245-ffad-435f-843e-aabbd04e8389 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.139117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20903-8167-47ea-bd73-8ae6fe7b2bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.139347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d84f3f-b088-420e-bf60-4903e48c9a61 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.140883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20903-8167-47ea-bd73-8ae6fe7b2bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.141599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20903-8167-47ea-bd73-8ae6fe7b2bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.142186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20903-8167-47ea-bd73-8ae6fe7b2bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.144271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b20903-8167-47ea-bd73-8ae6fe7b2bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.151583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b20903-8167-47ea-bd73-8ae6fe7b2bf6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.165990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68a5b-26b7-4f13-8539-b07f4a22adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.166687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68a5b-26b7-4f13-8539-b07f4a22adb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.166966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68a5b-26b7-4f13-8539-b07f4a22adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.167237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68a5b-26b7-4f13-8539-b07f4a22adb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.167975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a68a5b-26b7-4f13-8539-b07f4a22adb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.169873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a68a5b-26b7-4f13-8539-b07f4a22adb7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.207959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 890/1769] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:17.221344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68a5b-26b7-4f13-8539-b07f4a22adb7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.234905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68a5b-26b7-4f13-8539-b07f4a22adb7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.251832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12638d-6d7d-4977-b67c-bbb549b24d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.252764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12638d-6d7d-4977-b67c-bbb549b24d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.253184 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12638d-6d7d-4977-b67c-bbb549b24d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.253330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12638d-6d7d-4977-b67c-bbb549b24d6b admin admin] PATH_INFO: `/v3/projects/a579e0a970bb4f30837d9d7465bdf7ee/users/82e81679bff0443a9212137a0cfc0c03/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.266668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 880/1770] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:17 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:17.270582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20903-8167-47ea-bd73-8ae6fe7b2bf6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.291485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12638d-6d7d-4977-b67c-bbb549b24d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a579e0a970bb4f30837d9d7465bdf7ee, user_id=82e81679bff0443a9212137a0cfc0c03, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.297640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12638d-6d7d-4977-b67c-bbb549b24d6b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.324224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 891/1771] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:17 2022] PUT /identity/v3/projects/a579e0a970bb4f30837d9d7465bdf7ee/users/82e81679bff0443a9212137a0cfc0c03/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:17.330940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12638d-6d7d-4977-b67c-bbb549b24d6b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.351789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:17.406128 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20903-8167-47ea-bd73-8ae6fe7b2bf6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.412646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d33ef-4307-4496-81a7-11c3b6226d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.414090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d33ef-4307-4496-81a7-11c3b6226d0e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.414593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d33ef-4307-4496-81a7-11c3b6226d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.415430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d33ef-4307-4496-81a7-11c3b6226d0e admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.416441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d33ef-4307-4496-81a7-11c3b6226d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.417631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12638d-6d7d-4977-b67c-bbb549b24d6b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.419826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d33ef-4307-4496-81a7-11c3b6226d0e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.422899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b632-4e53-467b-9ef6-c97693351f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.423601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b632-4e53-467b-9ef6-c97693351f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.423889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b632-4e53-467b-9ef6-c97693351f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.424283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b632-4e53-467b-9ef6-c97693351f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.425029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49b632-4e53-467b-9ef6-c97693351f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.426657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49b632-4e53-467b-9ef6-c97693351f04 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.447207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 892/1772] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:17.448496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b632-4e53-467b-9ef6-c97693351f04 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.458381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 881/1773] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:17 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:17.459565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d33ef-4307-4496-81a7-11c3b6226d0e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.461930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b632-4e53-467b-9ef6-c97693351f04 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.474600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489d47f-5c19-45da-8d56-9ee962d0d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.476464 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d47f-5c19-45da-8d56-9ee962d0d3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.476753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d47f-5c19-45da-8d56-9ee962d0d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.477034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d47f-5c19-45da-8d56-9ee962d0d3ed admin admin] PATH_INFO: `/v3/projects/a579e0a970bb4f30837d9d7465bdf7ee/users/82e81679bff0443a9212137a0cfc0c03/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.480540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d33ef-4307-4496-81a7-11c3b6226d0e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.483165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489d47f-5c19-45da-8d56-9ee962d0d3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a579e0a970bb4f30837d9d7465bdf7ee, user_id=82e81679bff0443a9212137a0cfc0c03, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.487710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489d47f-5c19-45da-8d56-9ee962d0d3ed admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.495752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353416ab-aacd-46f5-a17c-727691b69303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.496478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353416ab-aacd-46f5-a17c-727691b69303 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.496764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353416ab-aacd-46f5-a17c-727691b69303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.497042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353416ab-aacd-46f5-a17c-727691b69303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.497855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353416ab-aacd-46f5-a17c-727691b69303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.499491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353416ab-aacd-46f5-a17c-727691b69303 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.512604 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:17.532973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 893/1774] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:17 2022] PUT /identity/v3/projects/a579e0a970bb4f30837d9d7465bdf7ee/users/82e81679bff0443a9212137a0cfc0c03/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:17.534605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790395dd-8eb2-4795-a80e-78fb6425db6b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.534848 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790395dd-8eb2-4795-a80e-78fb6425db6b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.536218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790395dd-8eb2-4795-a80e-78fb6425db6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.544054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 882/1775] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:17.548789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353416ab-aacd-46f5-a17c-727691b69303 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.580419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353416ab-aacd-46f5-a17c-727691b69303 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.589156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-790395dd-8eb2-4795-a80e-78fb6425db6b None None] MFA Rules not processed for user `82e81679bff0443a9212137a0cfc0c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:17.592595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-790395dd-8eb2-4795-a80e-78fb6425db6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:17.667058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c44bbd-7579-44f8-b440-86bfadcbf414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.667806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c44bbd-7579-44f8-b440-86bfadcbf414 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.668109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c44bbd-7579-44f8-b440-86bfadcbf414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.668383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c44bbd-7579-44f8-b440-86bfadcbf414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.669120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c44bbd-7579-44f8-b440-86bfadcbf414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.671739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c44bbd-7579-44f8-b440-86bfadcbf414 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.693144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 883/1776] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:17.699010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c44bbd-7579-44f8-b440-86bfadcbf414 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.704378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 894/1777] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:17.712990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790395dd-8eb2-4795-a80e-78fb6425db6b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.714525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c44bbd-7579-44f8-b440-86bfadcbf414 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.716495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-790395dd-8eb2-4795-a80e-78fb6425db6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:17.720568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b183cb-ed71-49d9-934b-79cc610f3348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.721688 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b183cb-ed71-49d9-934b-79cc610f3348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.722332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b183cb-ed71-49d9-934b-79cc610f3348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.722544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b183cb-ed71-49d9-934b-79cc610f3348 admin admin] PATH_INFO: `/v3/projects/9491fa0534294c778bbfd2209090ad3c/users/7804a234e21b4bee8605c11f3e2794b6/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.757983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b183cb-ed71-49d9-934b-79cc610f3348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9491fa0534294c778bbfd2209090ad3c, user_id=7804a234e21b4bee8605c11f3e2794b6, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:17.760764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b183cb-ed71-49d9-934b-79cc610f3348 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:17.817437 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 884/1778] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:17 2022] PUT /identity/v3/projects/9491fa0534294c778bbfd2209090ad3c/users/7804a234e21b4bee8605c11f3e2794b6/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:17.819605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b183cb-ed71-49d9-934b-79cc610f3348 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:17.820655 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790395dd-8eb2-4795-a80e-78fb6425db6b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.826055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-64b183cb-ed71-49d9-934b-79cc610f3348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:17.910398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:17.937397 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854c16b-d1ae-4594-bedd-3b44fef09a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:17.938077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c16b-d1ae-4594-bedd-3b44fef09a13 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:17.938360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c16b-d1ae-4594-bedd-3b44fef09a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:17.938797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c16b-d1ae-4594-bedd-3b44fef09a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:17.993065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b183cb-ed71-49d9-934b-79cc610f3348 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:17.999833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:18.001626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:18.002202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:18.003460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] PATH_INFO: `/v3/projects/233da9472517491d8a5b0ba81d264d7b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:18.005215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=233da9472517491d8a5b0ba81d264d7b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:18.007478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:18.063612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854c16b-d1ae-4594-bedd-3b44fef09a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:18.065143 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854c16b-d1ae-4594-bedd-3b44fef09a13 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:18.090217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 895/1779] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:18.091752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aec2a-2e0a-4178-9383-b45bcce87043 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:18.092070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aec2a-2e0a-4178-9383-b45bcce87043 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:18.092349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aec2a-2e0a-4178-9383-b45bcce87043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:18.129987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233da9472517491d8a5b0ba81d264d7b', 'request_id': 'req-bac56ec4-943d-4d84-ab49-293bcea8d507'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:18.145071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233da9472517491d8a5b0ba81d264d7b', 'request_id': 'req-bac56ec4-943d-4d84-ab49-293bcea8d507'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:18.158599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233da9472517491d8a5b0ba81d264d7b', 'request_id': 'req-bac56ec4-943d-4d84-ab49-293bcea8d507'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:18.168357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-287aec2a-2e0a-4178-9383-b45bcce87043 None None] MFA Rules not processed for user `7804a234e21b4bee8605c11f3e2794b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:18.171517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-287aec2a-2e0a-4178-9383-b45bcce87043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:18.185429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] The token cache is being invalidate because project 233da9472517491d8a5b0ba81d264d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:18.186907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:18.187752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:18.190242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 885/1780] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:17 2022] DELETE /identity/v3/projects/233da9472517491d8a5b0ba81d264d7b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:18.194169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:18.196937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:18.204843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:18.351861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 896/1781] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:18.353072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aec2a-2e0a-4178-9383-b45bcce87043 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:18.354836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-287aec2a-2e0a-4178-9383-b45bcce87043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:18.382537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac56ec4-943d-4d84-ab49-293bcea8d507 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:18.388478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:18.389992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:18.390407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:18.390687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] PATH_INFO: `/v3/users/8b2cf8806c0b42238cc8bf8bbac14e30` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:18.392133 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2cf8806c0b42238cc8bf8bbac14e30)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:18.394749 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:18.441278 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aec2a-2e0a-4178-9383-b45bcce87043 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:18.445828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcd229-bb4c-4f6b-9928-ca0e9c0c7c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:18.446657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcd229-bb4c-4f6b-9928-ca0e9c0c7c84 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:18.446953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcd229-bb4c-4f6b-9928-ca0e9c0c7c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:18.447230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcd229-bb4c-4f6b-9928-ca0e9c0c7c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:18.449386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c7bcd229-bb4c-4f6b-9928-ca0e9c0c7c84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:18.464559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2cf8806c0b42238cc8bf8bbac14e30'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:18.500154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2cf8806c0b42238cc8bf8bbac14e30'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:18.508723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2cf8806c0b42238cc8bf8bbac14e30'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:18.514843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:18.517706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2cf8806c0b42238cc8bf8bbac14e30'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:18.518572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2cf8806c0b42238cc8bf8bbac14e30'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:18.526142 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 886/1782] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:18 2022] DELETE /identity/v3/users/8b2cf8806c0b42238cc8bf8bbac14e30 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:18.527067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:18.528441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:18.573190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcd229-bb4c-4f6b-9928-ca0e9c0c7c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:18.577731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcd229-bb4c-4f6b-9928-ca0e9c0c7c84 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:18.602161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 897/1783] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:18.669645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a623e4-06d6-48a3-b38f-b472f8c59c2a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:18.685442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ba1a8-f7eb-462f-843f-a5ce035c6bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:18.686333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ba1a8-f7eb-462f-843f-a5ce035c6bed admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:18.686769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ba1a8-f7eb-462f-843f-a5ce035c6bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:18.687183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ba1a8-f7eb-462f-843f-a5ce035c6bed admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:18.688292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ba1a8-f7eb-462f-843f-a5ce035c6bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:18.691054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ba1a8-f7eb-462f-843f-a5ce035c6bed admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:18.765525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 887/1784] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:18 2022] POST /identity/v3/projects => generated 363 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:18.766645 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcd229-bb4c-4f6b-9928-ca0e9c0c7c84 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:18.769033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c7bcd229-bb4c-4f6b-9928-ca0e9c0c7c84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:18.794419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcd229-bb4c-4f6b-9928-ca0e9c0c7c84 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:18.943115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853c00e-150e-4476-9c3a-f4d81d7610ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:18.943932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853c00e-150e-4476-9c3a-f4d81d7610ee admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:18.944341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853c00e-150e-4476-9c3a-f4d81d7610ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:18.944821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853c00e-150e-4476-9c3a-f4d81d7610ee admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:18.945513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853c00e-150e-4476-9c3a-f4d81d7610ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:18.947608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853c00e-150e-4476-9c3a-f4d81d7610ee admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:18.983278 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 898/1785] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:18 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:18.984039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ba1a8-f7eb-462f-843f-a5ce035c6bed admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:18.990686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853c00e-150e-4476-9c3a-f4d81d7610ee admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:18.993622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a853c00e-150e-4476-9c3a-f4d81d7610ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:19.005303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ba1a8-f7eb-462f-843f-a5ce035c6bed admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.007675 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853c00e-150e-4476-9c3a-f4d81d7610ee admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.013354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.014372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.014663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.014940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] PATH_INFO: `/v3/projects/61fdf3d3bffe4c33989c6dd22a350f39` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.016184 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=61fdf3d3bffe4c33989c6dd22a350f39)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:19.018233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:19.027560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d767-83d9-44d8-b885-a32b9532a628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.028805 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d767-83d9-44d8-b885-a32b9532a628 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.030439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d767-83d9-44d8-b885-a32b9532a628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.030832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d767-83d9-44d8-b885-a32b9532a628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.032403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36d767-83d9-44d8-b885-a32b9532a628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:19.034220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36d767-83d9-44d8-b885-a32b9532a628 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:19.036111 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:19.056278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 888/1786] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:29:19.058723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d767-83d9-44d8-b885-a32b9532a628 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:19.072233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d767-83d9-44d8-b885-a32b9532a628 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.092585 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bbf1f-d1b8-48c0-82e4-8a767acfdf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.097828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bbf1f-d1b8-48c0-82e4-8a767acfdf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.098211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bbf1f-d1b8-48c0-82e4-8a767acfdf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.098549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bbf1f-d1b8-48c0-82e4-8a767acfdf78 admin admin] PATH_INFO: `/v3/projects/a1ba3648467e48c89316ad8fb7ea0845/users/50ac2f1b434143db9815d6c535eedc78/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.100906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61fdf3d3bffe4c33989c6dd22a350f39', 'request_id': 'req-25e153f9-dd01-4aec-b101-dc1598993fcc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:19.117447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61fdf3d3bffe4c33989c6dd22a350f39', 'request_id': 'req-25e153f9-dd01-4aec-b101-dc1598993fcc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:19.128066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61fdf3d3bffe4c33989c6dd22a350f39', 'request_id': 'req-25e153f9-dd01-4aec-b101-dc1598993fcc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:19.138283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bbf1f-d1b8-48c0-82e4-8a767acfdf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ba3648467e48c89316ad8fb7ea0845, user_id=50ac2f1b434143db9815d6c535eedc78, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:19.143180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bbf1f-d1b8-48c0-82e4-8a767acfdf78 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:19.155211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] The token cache is being invalidate because project 61fdf3d3bffe4c33989c6dd22a350f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:19.155540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:19.156253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-25e153f9-dd01-4aec-b101-dc1598993fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:19.161824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 899/1787] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:18 2022] DELETE /identity/v3/projects/61fdf3d3bffe4c33989c6dd22a350f39 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:19.163429 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e7cc4-bbcd-4c13-a26d-dcb9bcb8a8c1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.163789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e7cc4-bbcd-4c13-a26d-dcb9bcb8a8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.164169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e7cc4-bbcd-4c13-a26d-dcb9bcb8a8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.187557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fd3e7cc4-bbcd-4c13-a26d-dcb9bcb8a8c1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:19.192249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fd3e7cc4-bbcd-4c13-a26d-dcb9bcb8a8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:19.205036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 889/1788] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:19 2022] PUT /identity/v3/projects/a1ba3648467e48c89316ad8fb7ea0845/users/50ac2f1b434143db9815d6c535eedc78/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:19.207427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bbf1f-d1b8-48c0-82e4-8a767acfdf78 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:19.213795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3b4bbf1f-d1b8-48c0-82e4-8a767acfdf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:19.393308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bbf1f-d1b8-48c0-82e4-8a767acfdf78 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.409875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cc3bb-c41a-484f-b671-fc7447cf436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.411031 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cc3bb-c41a-484f-b671-fc7447cf436e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.412925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:19.413611 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cc3bb-c41a-484f-b671-fc7447cf436e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.413999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cc3bb-c41a-484f-b671-fc7447cf436e admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.416708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cc3bb-c41a-484f-b671-fc7447cf436e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:19.421011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cc3bb-c41a-484f-b671-fc7447cf436e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:19.451675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 890/1789] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:19.455939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cc3bb-c41a-484f-b671-fc7447cf436e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:19.476523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cc3bb-c41a-484f-b671-fc7447cf436e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.481516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 900/1790] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:19.488669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dea623-1c0c-46da-9d0d-ec4621a1c853 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.489339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dea623-1c0c-46da-9d0d-ec4621a1c853 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.491343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dea623-1c0c-46da-9d0d-ec4621a1c853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.491517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc38a0-e29d-42df-a560-02e521e2e9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.492473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc38a0-e29d-42df-a560-02e521e2e9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.492758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc38a0-e29d-42df-a560-02e521e2e9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.493037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc38a0-e29d-42df-a560-02e521e2e9ec admin admin] PATH_INFO: `/v3/projects/a1ba3648467e48c89316ad8fb7ea0845/users/50ac2f1b434143db9815d6c535eedc78/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.495149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc38a0-e29d-42df-a560-02e521e2e9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ba3648467e48c89316ad8fb7ea0845, user_id=50ac2f1b434143db9815d6c535eedc78, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:19.505463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc38a0-e29d-42df-a560-02e521e2e9ec admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:19.533702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 891/1791] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:19 2022] PUT /identity/v3/projects/a1ba3648467e48c89316ad8fb7ea0845/users/50ac2f1b434143db9815d6c535eedc78/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:19.543873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-05dea623-1c0c-46da-9d0d-ec4621a1c853 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:19.544494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-05dea623-1c0c-46da-9d0d-ec4621a1c853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:19.545817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390a58-0a47-43ed-9504-fdbb25965c53 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.545991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390a58-0a47-43ed-9504-fdbb25965c53 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.546267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390a58-0a47-43ed-9504-fdbb25965c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.603230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5b390a58-0a47-43ed-9504-fdbb25965c53 None None] MFA Rules not processed for user `50ac2f1b434143db9815d6c535eedc78`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:19.605852 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5b390a58-0a47-43ed-9504-fdbb25965c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:19.643629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 901/1792] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:19.647987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dea623-1c0c-46da-9d0d-ec4621a1c853 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:19.657881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dea623-1c0c-46da-9d0d-ec4621a1c853 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.663257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e661-84b4-420f-856f-4864158a66ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.663946 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e661-84b4-420f-856f-4864158a66ee admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.664271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e661-84b4-420f-856f-4864158a66ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.664551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e661-84b4-420f-856f-4864158a66ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.665713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973e661-84b4-420f-856f-4864158a66ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:19.666024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973e661-84b4-420f-856f-4864158a66ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:19.667658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973e661-84b4-420f-856f-4864158a66ee admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:19.697627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 902/1793] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:19.698497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e661-84b4-420f-856f-4864158a66ee admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:19.708962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e661-84b4-420f-856f-4864158a66ee admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.713635 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfb010-de4c-4ccf-9b1c-23a4add68532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.714307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfb010-de4c-4ccf-9b1c-23a4add68532 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.714589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfb010-de4c-4ccf-9b1c-23a4add68532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.714961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfb010-de4c-4ccf-9b1c-23a4add68532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.715856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfb010-de4c-4ccf-9b1c-23a4add68532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:19.717894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfb010-de4c-4ccf-9b1c-23a4add68532 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:19.729683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 892/1794] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:19.751214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b390a58-0a47-43ed-9504-fdbb25965c53 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:19.752778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5b390a58-0a47-43ed-9504-fdbb25965c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:19.757561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 903/1795] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:19 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:19.761465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfb010-de4c-4ccf-9b1c-23a4add68532 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:19.801246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:19.820644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b390a58-0a47-43ed-9504-fdbb25965c53 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.832758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfb010-de4c-4ccf-9b1c-23a4add68532 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.838856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ef7f3-6e5a-4e75-b7b4-9e0459a1c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.839682 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef7f3-6e5a-4e75-b7b4-9e0459a1c6cc admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.840094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef7f3-6e5a-4e75-b7b4-9e0459a1c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.840424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ef7f3-6e5a-4e75-b7b4-9e0459a1c6cc admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.841310 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ef7f3-6e5a-4e75-b7b4-9e0459a1c6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:19.843853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ef7f3-6e5a-4e75-b7b4-9e0459a1c6cc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:19.867858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 904/1796] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:19 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:19.872293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ef7f3-6e5a-4e75-b7b4-9e0459a1c6cc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:19.885040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ef7f3-6e5a-4e75-b7b4-9e0459a1c6cc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.892498 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406168-b315-46eb-b107-e7364642ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.893409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406168-b315-46eb-b107-e7364642ee91 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.893692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406168-b315-46eb-b107-e7364642ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.893972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44406168-b315-46eb-b107-e7364642ee91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.894962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44406168-b315-46eb-b107-e7364642ee91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:19.896451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44406168-b315-46eb-b107-e7364642ee91 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:19.908469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 905/1797] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:29:19.912536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406168-b315-46eb-b107-e7364642ee91 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:19.916889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47de274-bdf9-451c-828b-9fefe6aefeaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.922069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47de274-bdf9-451c-828b-9fefe6aefeaa service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.922478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47de274-bdf9-451c-828b-9fefe6aefeaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.922676 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47de274-bdf9-451c-828b-9fefe6aefeaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.927982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44406168-b315-46eb-b107-e7364642ee91 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.934506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aadb75-fa6f-461a-b91f-8cc53cb3ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.937087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aadb75-fa6f-461a-b91f-8cc53cb3ca8c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.937729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aadb75-fa6f-461a-b91f-8cc53cb3ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.938114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aadb75-fa6f-461a-b91f-8cc53cb3ca8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:19.939640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aadb75-fa6f-461a-b91f-8cc53cb3ca8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:19.942733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aadb75-fa6f-461a-b91f-8cc53cb3ca8c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:19.961613 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 906/1798] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:19.965920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aadb75-fa6f-461a-b91f-8cc53cb3ca8c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:19.983257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aadb75-fa6f-461a-b91f-8cc53cb3ca8c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:19.990896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f9945-271d-4c57-bf7a-54bf1f94637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:19.992824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f9945-271d-4c57-bf7a-54bf1f94637d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:19.993491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f9945-271d-4c57-bf7a-54bf1f94637d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:19.993911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f9945-271d-4c57-bf7a-54bf1f94637d admin admin] PATH_INFO: `/v3/projects/1c2bd54abb0c4b848caa285d56c3042d/users/0e197cb5d6df47718e3f94fb2b5c1c3f/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.014562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f9945-271d-4c57-bf7a-54bf1f94637d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2bd54abb0c4b848caa285d56c3042d, user_id=0e197cb5d6df47718e3f94fb2b5c1c3f, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.018267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f9945-271d-4c57-bf7a-54bf1f94637d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.021418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:20.053055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 907/1799] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:19 2022] PUT /identity/v3/projects/1c2bd54abb0c4b848caa285d56c3042d/users/0e197cb5d6df47718e3f94fb2b5c1c3f/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:20.054002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47de274-bdf9-451c-828b-9fefe6aefeaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.055582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47de274-bdf9-451c-828b-9fefe6aefeaa service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.066919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833679ff-8ea2-4c36-aeca-0609121d74e3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.067428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 893/1800] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:20.067703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833679ff-8ea2-4c36-aeca-0609121d74e3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.068073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833679ff-8ea2-4c36-aeca-0609121d74e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.106374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-833679ff-8ea2-4c36-aeca-0609121d74e3 None None] MFA Rules not processed for user `0e197cb5d6df47718e3f94fb2b5c1c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:20.107878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-833679ff-8ea2-4c36-aeca-0609121d74e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:20.151520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47de274-bdf9-451c-828b-9fefe6aefeaa service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:20.161099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47de274-bdf9-451c-828b-9fefe6aefeaa service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:20.183615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 908/1801] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:20.188174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833679ff-8ea2-4c36-aeca-0609121d74e3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:20.211939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e8173-c931-4372-b956-89bb1707c818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:20.212637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e8173-c931-4372-b956-89bb1707c818 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.212925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e8173-c931-4372-b956-89bb1707c818 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.213202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e8173-c931-4372-b956-89bb1707c818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.215043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8c0e8173-c931-4372-b956-89bb1707c818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:20.251891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833679ff-8ea2-4c36-aeca-0609121d74e3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:20.256610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cb70f-358d-4097-8801-07c0f788500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:20.257448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cb70f-358d-4097-8801-07c0f788500a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.257830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cb70f-358d-4097-8801-07c0f788500a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.258073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cb70f-358d-4097-8801-07c0f788500a admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.258798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cb70f-358d-4097-8801-07c0f788500a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.260833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cb70f-358d-4097-8801-07c0f788500a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.276184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e8173-c931-4372-b956-89bb1707c818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.277742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e8173-c931-4372-b956-89bb1707c818 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.282991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:20.287977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 894/1802] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:20.288602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 909/1803] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:20 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:20.292981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e8173-c931-4372-b956-89bb1707c818 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:20.304155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e8173-c931-4372-b956-89bb1707c818 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:20.362777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea2b31-7edf-4282-b931-7ab95e8b3e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:20.363580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea2b31-7edf-4282-b931-7ab95e8b3e8b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.363871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea2b31-7edf-4282-b931-7ab95e8b3e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.364194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea2b31-7edf-4282-b931-7ab95e8b3e8b admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.364898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea2b31-7edf-4282-b931-7ab95e8b3e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.366961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea2b31-7edf-4282-b931-7ab95e8b3e8b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.389415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 895/1804] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:20 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:20.394296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cb70f-358d-4097-8801-07c0f788500a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:20.404772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cb70f-358d-4097-8801-07c0f788500a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:20.411299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952844ff-a61f-455d-b620-052755459a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:20.412039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952844ff-a61f-455d-b620-052755459a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.412460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952844ff-a61f-455d-b620-052755459a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.412792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952844ff-a61f-455d-b620-052755459a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.413570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952844ff-a61f-455d-b620-052755459a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.415534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952844ff-a61f-455d-b620-052755459a7b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.432563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 910/1805] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:20.436841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea2b31-7edf-4282-b931-7ab95e8b3e8b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:20.447733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea2b31-7edf-4282-b931-7ab95e8b3e8b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:20.452810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a999c-2419-41f3-b929-d266c80f2936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:20.453848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a999c-2419-41f3-b929-d266c80f2936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.454126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a999c-2419-41f3-b929-d266c80f2936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.454492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a999c-2419-41f3-b929-d266c80f2936 admin admin] PATH_INFO: `/v3/projects/05df8ccee8884d1f93cdad808123145f/users/60253557dc7140788abf19182b1cd67a/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.471254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a999c-2419-41f3-b929-d266c80f2936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05df8ccee8884d1f93cdad808123145f, user_id=60253557dc7140788abf19182b1cd67a, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.474029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a999c-2419-41f3-b929-d266c80f2936 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.488289 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 896/1806] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:20 2022] PUT /identity/v3/projects/05df8ccee8884d1f93cdad808123145f/users/60253557dc7140788abf19182b1cd67a/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:20.492336 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952844ff-a61f-455d-b620-052755459a7b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:20.503013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952844ff-a61f-455d-b620-052755459a7b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:20.556156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:20.563797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49d8a7-9207-4617-a42a-fec98cd9e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:20.564594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d8a7-9207-4617-a42a-fec98cd9e1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.565166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d8a7-9207-4617-a42a-fec98cd9e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.565679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d8a7-9207-4617-a42a-fec98cd9e1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.566514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49d8a7-9207-4617-a42a-fec98cd9e1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.568368 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49d8a7-9207-4617-a42a-fec98cd9e1e0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.582410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 911/1807] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:20.586721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a999c-2419-41f3-b929-d266c80f2936 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:20.598275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a999c-2419-41f3-b929-d266c80f2936 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:20.603870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebae89c-19e8-4674-94dc-bd851876a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:20.604876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebae89c-19e8-4674-94dc-bd851876a65a admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.605231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebae89c-19e8-4674-94dc-bd851876a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.605581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebae89c-19e8-4674-94dc-bd851876a65a admin admin] PATH_INFO: `/v3/projects/05df8ccee8884d1f93cdad808123145f/users/60253557dc7140788abf19182b1cd67a/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.607971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebae89c-19e8-4674-94dc-bd851876a65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=05df8ccee8884d1f93cdad808123145f, user_id=60253557dc7140788abf19182b1cd67a, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.610816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebae89c-19e8-4674-94dc-bd851876a65a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.624470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 897/1808] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:20 2022] PUT /identity/v3/projects/05df8ccee8884d1f93cdad808123145f/users/60253557dc7140788abf19182b1cd67a/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:20.635973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc3be-a334-49f6-b209-014b9bf493c2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.636350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc3be-a334-49f6-b209-014b9bf493c2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.636579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc3be-a334-49f6-b209-014b9bf493c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.672343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-789dc3be-a334-49f6-b209-014b9bf493c2 None None] MFA Rules not processed for user `60253557dc7140788abf19182b1cd67a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:20.673617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-789dc3be-a334-49f6-b209-014b9bf493c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:20.748636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebae89c-19e8-4674-94dc-bd851876a65a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:20.750535 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-aebae89c-19e8-4674-94dc-bd851876a65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:20.791641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 912/1809] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:20.803693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dc3be-a334-49f6-b209-014b9bf493c2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:20.805580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-789dc3be-a334-49f6-b209-014b9bf493c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:20.853976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebae89c-19e8-4674-94dc-bd851876a65a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:20.859466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:20.860399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.860680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.860950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] PATH_INFO: `/v3/users/66df948e1af04ecd9fb9eb75e2b0478f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.862216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] RBAC: Authorizing `identity:delete_user(user_id=66df948e1af04ecd9fb9eb75e2b0478f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.864245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.882806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dc3be-a334-49f6-b209-014b9bf493c2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:20.887837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1967053-8668-4e72-8944-2d18549742eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:20.888880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1967053-8668-4e72-8944-2d18549742eb service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:20.889331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1967053-8668-4e72-8944-2d18549742eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:20.889900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1967053-8668-4e72-8944-2d18549742eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:20.905348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1967053-8668-4e72-8944-2d18549742eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:20.907258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1967053-8668-4e72-8944-2d18549742eb service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:20.921195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 913/1810] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:20.950671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66df948e1af04ecd9fb9eb75e2b0478f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:20.961510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:20.984877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66df948e1af04ecd9fb9eb75e2b0478f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:20.995002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66df948e1af04ecd9fb9eb75e2b0478f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:20.995418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1967053-8668-4e72-8944-2d18549742eb service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:21.003966 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66df948e1af04ecd9fb9eb75e2b0478f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.004829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9fcf9383-5b06-4b50-beaf-78f46a20271b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66df948e1af04ecd9fb9eb75e2b0478f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.006036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1967053-8668-4e72-8944-2d18549742eb service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:21.010474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848ee2-3cc6-4139-94dd-cecbf043c0f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:21.011219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848ee2-3cc6-4139-94dd-cecbf043c0f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:21.011571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848ee2-3cc6-4139-94dd-cecbf043c0f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:21.012119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42848ee2-3cc6-4139-94dd-cecbf043c0f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:21.017154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 898/1811] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:20 2022] DELETE /identity/v3/users/66df948e1af04ecd9fb9eb75e2b0478f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:21.017666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-42848ee2-3cc6-4139-94dd-cecbf043c0f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:21.018570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6d1f-e238-4ed3-a761-3d3eef0e5605 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:21.018877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6d1f-e238-4ed3-a761-3d3eef0e5605 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:21.019131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e6d1f-e238-4ed3-a761-3d3eef0e5605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:21.038286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-082e6d1f-e238-4ed3-a761-3d3eef0e5605 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:21.039497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-082e6d1f-e238-4ed3-a761-3d3eef0e5605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:21.096909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42848ee2-3cc6-4139-94dd-cecbf043c0f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:21.098361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42848ee2-3cc6-4139-94dd-cecbf043c0f5 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:21.114350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 899/1812] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:21.126838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 914/1813] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:21.127757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6d1f-e238-4ed3-a761-3d3eef0e5605 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:21.129256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-082e6d1f-e238-4ed3-a761-3d3eef0e5605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:21.194985 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e6d1f-e238-4ed3-a761-3d3eef0e5605 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:21.210430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb0f1-a153-49e7-80e2-74b1d2a2462a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:21.211626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb0f1-a153-49e7-80e2-74b1d2a2462a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:21.211854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb0f1-a153-49e7-80e2-74b1d2a2462a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:21.212847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb0f1-a153-49e7-80e2-74b1d2a2462a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:21.227967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cb0f1-a153-49e7-80e2-74b1d2a2462a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:21.229918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cb0f1-a153-49e7-80e2-74b1d2a2462a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:21.244304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 900/1814] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:21.631653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848ee2-3cc6-4139-94dd-cecbf043c0f5 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:21.633234 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-42848ee2-3cc6-4139-94dd-cecbf043c0f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:21.650760 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42848ee2-3cc6-4139-94dd-cecbf043c0f5 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:21.656803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:21.658310 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:21.658310 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:21.658650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] PATH_INFO: `/v3/projects/d45ebb59cbd44217ab1a912a4b5393ca` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:21.660630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45ebb59cbd44217ab1a912a4b5393ca)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:21.663876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:21.683030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:21.720524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45ebb59cbd44217ab1a912a4b5393ca', 'request_id': 'req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.729541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45ebb59cbd44217ab1a912a4b5393ca', 'request_id': 'req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.736304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45ebb59cbd44217ab1a912a4b5393ca', 'request_id': 'req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.748290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] The token cache is being invalidate because project d45ebb59cbd44217ab1a912a4b5393ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:21.748578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.749221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.750824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 915/1815] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:21 2022] DELETE /identity/v3/projects/d45ebb59cbd44217ab1a912a4b5393ca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:21.755033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb0f1-a153-49e7-80e2-74b1d2a2462a service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:21.765707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb0f1-a153-49e7-80e2-74b1d2a2462a service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:21.843304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:21.844332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:21.844675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:21.845011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] PATH_INFO: `/v3/users/18c7357ac72d481b9f054510cd02abe5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:21.846518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c7357ac72d481b9f054510cd02abe5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:21.849083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:21.873136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:21.899976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c7357ac72d481b9f054510cd02abe5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.916562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c7357ac72d481b9f054510cd02abe5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.925434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c7357ac72d481b9f054510cd02abe5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.933016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c7357ac72d481b9f054510cd02abe5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.933721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c7357ac72d481b9f054510cd02abe5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:21.940176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 901/1816] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:21 2022] DELETE /identity/v3/users/18c7357ac72d481b9f054510cd02abe5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:22.298909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:22.301114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:22.321079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52bab-f4fa-49fb-9ce5-a259c8adc078 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:22.340264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:22.342300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:22.395979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:22.397366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:22.397761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:22.398239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] PATH_INFO: `/v3/projects/906685255a624281a8fcdd85b401e312` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:22.400618 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=906685255a624281a8fcdd85b401e312)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:22.402878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:22.435360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073691e-603f-4ec6-b058-13d051a5eae8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:22.444387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:22.445298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:22.445600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:22.445841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] PATH_INFO: `/v3/users/faadc409545b40eabdb986e952589a38` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:22.448782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faadc409545b40eabdb986e952589a38)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:22.451060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:22.501722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906685255a624281a8fcdd85b401e312', 'request_id': 'req-348ca066-b337-471f-ab8e-991bdd573081'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:22.511518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906685255a624281a8fcdd85b401e312', 'request_id': 'req-348ca066-b337-471f-ab8e-991bdd573081'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:22.517046 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faadc409545b40eabdb986e952589a38'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:22.519230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906685255a624281a8fcdd85b401e312', 'request_id': 'req-348ca066-b337-471f-ab8e-991bdd573081'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:22.532528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] The token cache is being invalidate because project 906685255a624281a8fcdd85b401e312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:22.532815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:22.533564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-348ca066-b337-471f-ab8e-991bdd573081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:22.535944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 916/1817] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:22 2022] DELETE /identity/v3/projects/906685255a624281a8fcdd85b401e312 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:22.541167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faadc409545b40eabdb986e952589a38'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:22.541315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673f97-44cc-4179-bdcd-b0d40185dbb5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:22.541601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673f97-44cc-4179-bdcd-b0d40185dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:22.541879 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673f97-44cc-4179-bdcd-b0d40185dbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:22.554183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faadc409545b40eabdb986e952589a38'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:22.563994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faadc409545b40eabdb986e952589a38'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:22.564860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-96673f97-44cc-4179-bdcd-b0d40185dbb5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:22.564976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-602f4c22-9592-4ca2-b856-5ae582119311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faadc409545b40eabdb986e952589a38'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:22.566080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-96673f97-44cc-4179-bdcd-b0d40185dbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:22.575489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 902/1818] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:22 2022] DELETE /identity/v3/users/faadc409545b40eabdb986e952589a38 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:22.577793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0a09e-bf6c-459f-8f6e-98994bef4694 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:22.578186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0a09e-bf6c-459f-8f6e-98994bef4694 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:22.578705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0a09e-bf6c-459f-8f6e-98994bef4694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:22.606827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-16d0a09e-bf6c-459f-8f6e-98994bef4694 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:22.608724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-16d0a09e-bf6c-459f-8f6e-98994bef4694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:22.619525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:22.622803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:22.672064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 917/1819] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:22.681536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4008-96bd-4ba3-aa93-2b1c55329041 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:22.681938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4008-96bd-4ba3-aa93-2b1c55329041 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:22.682286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c4008-96bd-4ba3-aa93-2b1c55329041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:22.690408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 903/1820] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:22.699897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0a09e-bf6c-459f-8f6e-98994bef4694 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:22.701488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-16d0a09e-bf6c-459f-8f6e-98994bef4694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:22.705094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7a9c4008-96bd-4ba3-aa93-2b1c55329041 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:22.706274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7a9c4008-96bd-4ba3-aa93-2b1c55329041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:22.714586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 918/1821] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:22.719295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4008-96bd-4ba3-aa93-2b1c55329041 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:22.735029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c4008-96bd-4ba3-aa93-2b1c55329041 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:22.740697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320e7f-e795-49f5-b816-ab901421de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:22.741378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320e7f-e795-49f5-b816-ab901421de7a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:22.741663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320e7f-e795-49f5-b816-ab901421de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:22.741939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320e7f-e795-49f5-b816-ab901421de7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:22.742682 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7320e7f-e795-49f5-b816-ab901421de7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:22.742982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7320e7f-e795-49f5-b816-ab901421de7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:22.744819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7320e7f-e795-49f5-b816-ab901421de7a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:22.757542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 919/1822] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:29:22.762494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320e7f-e795-49f5-b816-ab901421de7a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:22.765253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0a09e-bf6c-459f-8f6e-98994bef4694 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:22.768881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2a073-ad23-488d-9688-981f9740429a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:22.769535 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2a073-ad23-488d-9688-981f9740429a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:22.769804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2a073-ad23-488d-9688-981f9740429a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:22.770140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2a073-ad23-488d-9688-981f9740429a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:22.773624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320e7f-e795-49f5-b816-ab901421de7a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:22.778415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e402c46-340e-4771-9f4d-22bfbd995d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:22.779128 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e402c46-340e-4771-9f4d-22bfbd995d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:22.779419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e402c46-340e-4771-9f4d-22bfbd995d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:22.779705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e402c46-340e-4771-9f4d-22bfbd995d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:22.780628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e402c46-340e-4771-9f4d-22bfbd995d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:22.782711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e402c46-340e-4771-9f4d-22bfbd995d26 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:22.783228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2a073-ad23-488d-9688-981f9740429a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:22.786242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2a073-ad23-488d-9688-981f9740429a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:22.801986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 904/1823] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:22.816943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 920/1824] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:22 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:22.821466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2a073-ad23-488d-9688-981f9740429a service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:22.833203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2a073-ad23-488d-9688-981f9740429a service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:22.921886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0193b-2cad-40b9-8f3e-c7420503107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:22.922834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0193b-2cad-40b9-8f3e-c7420503107c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:22.923307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0193b-2cad-40b9-8f3e-c7420503107c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:22.923587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0193b-2cad-40b9-8f3e-c7420503107c admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:22.924554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0193b-2cad-40b9-8f3e-c7420503107c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:22.926783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0193b-2cad-40b9-8f3e-c7420503107c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:22.958929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 905/1825] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:22 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:22.963420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e402c46-340e-4771-9f4d-22bfbd995d26 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:22.979836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e402c46-340e-4771-9f4d-22bfbd995d26 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:23.000377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48a932-3d7a-42fe-9dfb-5facce200134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:23.001866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a932-3d7a-42fe-9dfb-5facce200134 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:23.001866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a932-3d7a-42fe-9dfb-5facce200134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:23.001866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a932-3d7a-42fe-9dfb-5facce200134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:23.002815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48a932-3d7a-42fe-9dfb-5facce200134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:23.006028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48a932-3d7a-42fe-9dfb-5facce200134 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:23.044966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 921/1826] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:29:23.048663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0193b-2cad-40b9-8f3e-c7420503107c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:23.062022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0193b-2cad-40b9-8f3e-c7420503107c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:23.069084 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72188dd-9f02-41bd-bda7-af64e8288c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:23.069778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72188dd-9f02-41bd-bda7-af64e8288c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:23.070057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72188dd-9f02-41bd-bda7-af64e8288c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:23.070330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72188dd-9f02-41bd-bda7-af64e8288c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:23.071071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72188dd-9f02-41bd-bda7-af64e8288c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:23.072776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72188dd-9f02-41bd-bda7-af64e8288c7f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:23.085508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 906/1827] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:23.090329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48a932-3d7a-42fe-9dfb-5facce200134 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:23.107025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48a932-3d7a-42fe-9dfb-5facce200134 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:23.122626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb198dd-c56b-48fd-9b95-06f2e9696737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:23.127478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb198dd-c56b-48fd-9b95-06f2e9696737 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:23.127893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb198dd-c56b-48fd-9b95-06f2e9696737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:23.129848 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb198dd-c56b-48fd-9b95-06f2e9696737 admin admin] PATH_INFO: `/v3/projects/385381b464504136b104d04d47c7f872/users/e21d920404f542f196d023ceb9b4d193/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:23.165453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb198dd-c56b-48fd-9b95-06f2e9696737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385381b464504136b104d04d47c7f872, user_id=e21d920404f542f196d023ceb9b4d193, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:23.170205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb198dd-c56b-48fd-9b95-06f2e9696737 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:23.204425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 922/1828] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:23 2022] PUT /identity/v3/projects/385381b464504136b104d04d47c7f872/users/e21d920404f542f196d023ceb9b4d193/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:23.208740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74030cb-a234-48c4-9b64-252feb45a819 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:23.209331 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74030cb-a234-48c4-9b64-252feb45a819 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:23.209331 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74030cb-a234-48c4-9b64-252feb45a819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:23.232288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb198dd-c56b-48fd-9b95-06f2e9696737 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:23.234171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8eb198dd-c56b-48fd-9b95-06f2e9696737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:23.303178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f74030cb-a234-48c4-9b64-252feb45a819 None None] MFA Rules not processed for user `e21d920404f542f196d023ceb9b4d193`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:23.304964 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f74030cb-a234-48c4-9b64-252feb45a819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:23.339513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb198dd-c56b-48fd-9b95-06f2e9696737 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:23.347962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:23.350696 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:23.350991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:23.351276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] PATH_INFO: `/v3/projects/d29e240831784706b328cb1d4e975515` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:23.355440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29e240831784706b328cb1d4e975515)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:23.357443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:23.360066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:23.429990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 907/1829] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:23.434885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74030cb-a234-48c4-9b64-252feb45a819 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:23.437513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29e240831784706b328cb1d4e975515', 'request_id': 'req-c63e7edd-b731-481f-8103-83bc04db43ba'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:23.448193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29e240831784706b328cb1d4e975515', 'request_id': 'req-c63e7edd-b731-481f-8103-83bc04db43ba'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:23.450132 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74030cb-a234-48c4-9b64-252feb45a819 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:23.451151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:23.466215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29e240831784706b328cb1d4e975515', 'request_id': 'req-c63e7edd-b731-481f-8103-83bc04db43ba'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:23.472351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] The token cache is being invalidate because project d29e240831784706b328cb1d4e975515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:23.473015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:23.474206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:23.476066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 923/1830] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:23 2022] DELETE /identity/v3/projects/d29e240831784706b328cb1d4e975515 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:23.480285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:23.483810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:23.526001 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16ab4f-bc8f-4b61-bd29-bde43517af93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:23.526846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16ab4f-bc8f-4b61-bd29-bde43517af93 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:23.527112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16ab4f-bc8f-4b61-bd29-bde43517af93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:23.527564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16ab4f-bc8f-4b61-bd29-bde43517af93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:23.528799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16ab4f-bc8f-4b61-bd29-bde43517af93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:23.530923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16ab4f-bc8f-4b61-bd29-bde43517af93 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:23.568666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 908/1831] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:23 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:23.570254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16ab4f-bc8f-4b61-bd29-bde43517af93 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:23.574083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9b16ab4f-bc8f-4b61-bd29-bde43517af93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:23.577673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7edd-b731-481f-8103-83bc04db43ba admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:23.683534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:23.684672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16ab4f-bc8f-4b61-bd29-bde43517af93 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:23.684903 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:23.685277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:23.686110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] PATH_INFO: `/v3/users/f6fdedb3e25a44998febb2906f705367` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:23.687715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6fdedb3e25a44998febb2906f705367)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:23.689941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:23.694954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c74e7-44d5-40c2-97f1-b24eca3cf124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:23.695919 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c74e7-44d5-40c2-97f1-b24eca3cf124 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:23.696369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c74e7-44d5-40c2-97f1-b24eca3cf124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:23.696658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c74e7-44d5-40c2-97f1-b24eca3cf124 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:23.697435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c74e7-44d5-40c2-97f1-b24eca3cf124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:23.699474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c74e7-44d5-40c2-97f1-b24eca3cf124 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:23.730672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 909/1832] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:23 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:23.734781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c74e7-44d5-40c2-97f1-b24eca3cf124 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:23.749057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c74e7-44d5-40c2-97f1-b24eca3cf124 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:23.756126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdf042-0713-474b-82be-ad42be66ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:23.757536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdf042-0713-474b-82be-ad42be66ec26 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:23.757536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdf042-0713-474b-82be-ad42be66ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:23.757536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdf042-0713-474b-82be-ad42be66ec26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:23.758358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdf042-0713-474b-82be-ad42be66ec26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:23.760021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdf042-0713-474b-82be-ad42be66ec26 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:23.771649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 910/1833] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:23.772697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6fdedb3e25a44998febb2906f705367'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:23.774159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6fdedb3e25a44998febb2906f705367'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:23.775967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdf042-0713-474b-82be-ad42be66ec26 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:23.786915 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdf042-0713-474b-82be-ad42be66ec26 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:23.793107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6fdedb3e25a44998febb2906f705367'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:23.793926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6fdedb3e25a44998febb2906f705367'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:23.794405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdf8ef-b5a0-411b-b5f1-7ade0d078aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:23.795326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf8ef-b5a0-411b-b5f1-7ade0d078aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:23.795876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf8ef-b5a0-411b-b5f1-7ade0d078aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:23.796212 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf8ef-b5a0-411b-b5f1-7ade0d078aa1 admin admin] PATH_INFO: `/v3/projects/4a37d56163ac412abdfca2bef35c62b4/users/253e6803905b48f6885e6d6d17e2f75c/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:23.805306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6fdedb3e25a44998febb2906f705367'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:23.820963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdf8ef-b5a0-411b-b5f1-7ade0d078aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a37d56163ac412abdfca2bef35c62b4, user_id=253e6803905b48f6885e6d6d17e2f75c, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:23.823941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdf8ef-b5a0-411b-b5f1-7ade0d078aa1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:23.831873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 924/1834] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:23 2022] DELETE /identity/v3/users/f6fdedb3e25a44998febb2906f705367 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:23.841808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 911/1835] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:23 2022] PUT /identity/v3/projects/4a37d56163ac412abdfca2bef35c62b4/users/253e6803905b48f6885e6d6d17e2f75c/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:23.845835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:23.848031 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:23.865581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:23.929991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f57204-dd7b-4a3d-8a83-7788b1aa6ffb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:24.014081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc4ed8-40bb-40f3-ae26-9cc5b5d88b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:24.014868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc4ed8-40bb-40f3-ae26-9cc5b5d88b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:24.015574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc4ed8-40bb-40f3-ae26-9cc5b5d88b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:24.015855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc4ed8-40bb-40f3-ae26-9cc5b5d88b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:24.016631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc4ed8-40bb-40f3-ae26-9cc5b5d88b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:24.018327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc4ed8-40bb-40f3-ae26-9cc5b5d88b18 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:24.031574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 925/1836] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:29:24.034626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdf8ef-b5a0-411b-b5f1-7ade0d078aa1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:24.041701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:24.046880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdf8ef-b5a0-411b-b5f1-7ade0d078aa1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:24.054750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085453e8-e74c-46d9-a2e3-74ef07050e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:24.055763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085453e8-e74c-46d9-a2e3-74ef07050e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:24.056145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085453e8-e74c-46d9-a2e3-74ef07050e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:24.056543 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085453e8-e74c-46d9-a2e3-74ef07050e09 admin admin] PATH_INFO: `/v3/projects/4a37d56163ac412abdfca2bef35c62b4/users/253e6803905b48f6885e6d6d17e2f75c/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:24.059397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085453e8-e74c-46d9-a2e3-74ef07050e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a37d56163ac412abdfca2bef35c62b4, user_id=253e6803905b48f6885e6d6d17e2f75c, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:24.062248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085453e8-e74c-46d9-a2e3-74ef07050e09 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:24.075778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 912/1837] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:24 2022] PUT /identity/v3/projects/4a37d56163ac412abdfca2bef35c62b4/users/253e6803905b48f6885e6d6d17e2f75c/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:24.085588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30fa9-6f92-4277-bdae-0bc06fd07ed4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:24.085885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30fa9-6f92-4277-bdae-0bc06fd07ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:24.086181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30fa9-6f92-4277-bdae-0bc06fd07ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:24.118672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-52a30fa9-6f92-4277-bdae-0bc06fd07ed4 None None] MFA Rules not processed for user `253e6803905b48f6885e6d6d17e2f75c`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:24.120259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-52a30fa9-6f92-4277-bdae-0bc06fd07ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:24.140613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085453e8-e74c-46d9-a2e3-74ef07050e09 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:24.143315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-085453e8-e74c-46d9-a2e3-74ef07050e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:24.215753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 926/1838] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:24.219151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1acdf5-c27f-498a-867b-1c7e08e7c0d4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:24.219651 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1acdf5-c27f-498a-867b-1c7e08e7c0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:24.220186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1acdf5-c27f-498a-867b-1c7e08e7c0d4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:24.223994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 927/1839] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:29:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:29:24.227734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1acdf5-c27f-498a-867b-1c7e08e7c0d4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:24.230597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dd1acdf5-c27f-498a-867b-1c7e08e7c0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:24.254040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085453e8-e74c-46d9-a2e3-74ef07050e09 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:24.268235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:24.269183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:24.269473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:24.269749 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] PATH_INFO: `/v3/projects/4b0fea725a42422da437a1dba5ff216f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:24.271049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0fea725a42422da437a1dba5ff216f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:24.273040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:24.306292 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:24.322575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1acdf5-c27f-498a-867b-1c7e08e7c0d4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:24.337139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0fea725a42422da437a1dba5ff216f', 'request_id': 'req-0ce8c875-ead7-43dc-8686-573519bcf927'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:24.343115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0fea725a42422da437a1dba5ff216f', 'request_id': 'req-0ce8c875-ead7-43dc-8686-573519bcf927'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:24.350225 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0fea725a42422da437a1dba5ff216f', 'request_id': 'req-0ce8c875-ead7-43dc-8686-573519bcf927'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:24.365483 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] The token cache is being invalidate because project 4b0fea725a42422da437a1dba5ff216f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:24.366118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:24.366625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0ce8c875-ead7-43dc-8686-573519bcf927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:24.371413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 913/1840] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:24 2022] DELETE /identity/v3/projects/4b0fea725a42422da437a1dba5ff216f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:24.371413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89633-06b6-430a-b5d4-d5467e800ee9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:24.371413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89633-06b6-430a-b5d4-d5467e800ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:24.371413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89633-06b6-430a-b5d4-d5467e800ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:24.386219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7bb3d-6864-41e9-84ad-82010866f899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:24.387601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7bb3d-6864-41e9-84ad-82010866f899 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:24.388042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7bb3d-6864-41e9-84ad-82010866f899 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:24.388330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7bb3d-6864-41e9-84ad-82010866f899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:24.389349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-05a89633-06b6-430a-b5d4-d5467e800ee9 None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:24.390729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b0c7bb3d-6864-41e9-84ad-82010866f899 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:24.390848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-05a89633-06b6-430a-b5d4-d5467e800ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:24.481222 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7bb3d-6864-41e9-84ad-82010866f899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:24.485150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7bb3d-6864-41e9-84ad-82010866f899 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:24.496127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 928/1841] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:24.497260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7bb3d-6864-41e9-84ad-82010866f899 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:24.498708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b0c7bb3d-6864-41e9-84ad-82010866f899 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:24.503677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 914/1842] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:29:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:24.614305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7bb3d-6864-41e9-84ad-82010866f899 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:24.623686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:24.624892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:24.625185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:24.625461 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] PATH_INFO: `/v3/users/82e81679bff0443a9212137a0cfc0c03` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:24.626850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e81679bff0443a9212137a0cfc0c03)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:24.629902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:24.678386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89633-06b6-430a-b5d4-d5467e800ee9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:24.681206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-05a89633-06b6-430a-b5d4-d5467e800ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:24.700822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89633-06b6-430a-b5d4-d5467e800ee9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:24.723092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e81679bff0443a9212137a0cfc0c03'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:24.723791 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e81679bff0443a9212137a0cfc0c03'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:24.724751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14640ea-7400-4ac2-a97b-acb56b56182c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:24.725763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14640ea-7400-4ac2-a97b-acb56b56182c service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:24.726036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:24.726563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14640ea-7400-4ac2-a97b-acb56b56182c service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:24.727258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14640ea-7400-4ac2-a97b-acb56b56182c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:24.740073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14640ea-7400-4ac2-a97b-acb56b56182c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:24.742179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14640ea-7400-4ac2-a97b-acb56b56182c service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:24.744147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e81679bff0443a9212137a0cfc0c03'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:24.745119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e81679bff0443a9212137a0cfc0c03'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:24.757269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e81679bff0443a9212137a0cfc0c03'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:24.758832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:24.768362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 915/1843] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:24.788681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 929/1844] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:24 2022] DELETE /identity/v3/users/82e81679bff0443a9212137a0cfc0c03 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:25.066469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14640ea-7400-4ac2-a97b-acb56b56182c service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:25.068061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b14640ea-7400-4ac2-a97b-acb56b56182c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:25.092059 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14640ea-7400-4ac2-a97b-acb56b56182c service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:25.173141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:25.173625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:25.174722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.175075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.175544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:25.175729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] PATH_INFO: `/v3/users/0e197cb5d6df47718e3f94fb2b5c1c3f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.177177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e197cb5d6df47718e3f94fb2b5c1c3f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:25.179620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:25.207418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ae5df-6378-410d-a6f4-689af2a8a3c9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:25.215849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:25.217077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.217394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.217709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] PATH_INFO: `/v3/projects/a579e0a970bb4f30837d9d7465bdf7ee` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.219042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a579e0a970bb4f30837d9d7465bdf7ee)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:25.221548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:25.267324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e197cb5d6df47718e3f94fb2b5c1c3f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:25.288720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e197cb5d6df47718e3f94fb2b5c1c3f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:25.304195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a579e0a970bb4f30837d9d7465bdf7ee', 'request_id': 'req-5de84992-c6ec-4a8a-8f52-0dbbca741f10'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:25.305845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e197cb5d6df47718e3f94fb2b5c1c3f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:25.317242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e197cb5d6df47718e3f94fb2b5c1c3f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:25.317442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a579e0a970bb4f30837d9d7465bdf7ee', 'request_id': 'req-5de84992-c6ec-4a8a-8f52-0dbbca741f10'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:25.317964 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e4fcaf18-2999-4d96-8ed2-53a873ad03a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e197cb5d6df47718e3f94fb2b5c1c3f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:25.326392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 916/1845] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:25 2022] DELETE /identity/v3/users/0e197cb5d6df47718e3f94fb2b5c1c3f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:25.329255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a579e0a970bb4f30837d9d7465bdf7ee', 'request_id': 'req-5de84992-c6ec-4a8a-8f52-0dbbca741f10'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:25.331214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2754ff0-556b-4bb4-8a6f-16e70efd991c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.331651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2754ff0-556b-4bb4-8a6f-16e70efd991c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.332155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2754ff0-556b-4bb4-8a6f-16e70efd991c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.349382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] The token cache is being invalidate because project a579e0a970bb4f30837d9d7465bdf7ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:25.349928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:25.350733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5de84992-c6ec-4a8a-8f52-0dbbca741f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:25.352892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 930/1846] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:25 2022] DELETE /identity/v3/projects/a579e0a970bb4f30837d9d7465bdf7ee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:25.360404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da408d39-0399-48fb-9986-ae1d63bceadf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.361191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da408d39-0399-48fb-9986-ae1d63bceadf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.361367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e2754ff0-556b-4bb4-8a6f-16e70efd991c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:25.362054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da408d39-0399-48fb-9986-ae1d63bceadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.362600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e2754ff0-556b-4bb4-8a6f-16e70efd991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:25.388786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-da408d39-0399-48fb-9986-ae1d63bceadf None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:25.389979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da408d39-0399-48fb-9986-ae1d63bceadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:25.438898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 917/1847] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:25.448629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2754ff0-556b-4bb4-8a6f-16e70efd991c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:25.450325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e2754ff0-556b-4bb4-8a6f-16e70efd991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:25.459133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 931/1848] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:25.468874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff581c-3a18-44c0-b056-d2a8227d0a15 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.469316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff581c-3a18-44c0-b056-d2a8227d0a15 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.469982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff581c-3a18-44c0-b056-d2a8227d0a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.485716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:25.490313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-70ff581c-3a18-44c0-b056-d2a8227d0a15 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:25.491761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-70ff581c-3a18-44c0-b056-d2a8227d0a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:25.501334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 932/1849] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:25.505691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff581c-3a18-44c0-b056-d2a8227d0a15 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:25.515579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff581c-3a18-44c0-b056-d2a8227d0a15 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:25.521314 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd30f4-fcf6-4fe8-984e-3f4db53a4ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:25.522174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd30f4-fcf6-4fe8-984e-3f4db53a4ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.522462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd30f4-fcf6-4fe8-984e-3f4db53a4ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.522743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd30f4-fcf6-4fe8-984e-3f4db53a4ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.523498 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd30f4-fcf6-4fe8-984e-3f4db53a4ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:25.523809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd30f4-fcf6-4fe8-984e-3f4db53a4ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:25.525518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd30f4-fcf6-4fe8-984e-3f4db53a4ca5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:25.533859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2754ff0-556b-4bb4-8a6f-16e70efd991c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:25.538920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89363a6b-5035-4671-a38d-542e0e085b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:25.539616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89363a6b-5035-4671-a38d-542e0e085b13 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.540377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 933/1850] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:25.540510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89363a6b-5035-4671-a38d-542e0e085b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.540715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89363a6b-5035-4671-a38d-542e0e085b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.544792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd30f4-fcf6-4fe8-984e-3f4db53a4ca5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:25.551156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89363a6b-5035-4671-a38d-542e0e085b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:25.552670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89363a6b-5035-4671-a38d-542e0e085b13 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:25.556547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd30f4-fcf6-4fe8-984e-3f4db53a4ca5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:25.562076 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c94fe-7196-4785-87ed-684cb54e6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:25.562764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c94fe-7196-4785-87ed-684cb54e6702 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.563042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c94fe-7196-4785-87ed-684cb54e6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.563313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c94fe-7196-4785-87ed-684cb54e6702 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.564053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c94fe-7196-4785-87ed-684cb54e6702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:25.564692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 918/1851] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:25.566081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c94fe-7196-4785-87ed-684cb54e6702 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:25.603090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 934/1852] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:25 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:25.604815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89363a6b-5035-4671-a38d-542e0e085b13 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:25.619700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89363a6b-5035-4671-a38d-542e0e085b13 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:25.696912 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc078b-9e57-48b2-bf6f-99aad69d5133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:25.697721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc078b-9e57-48b2-bf6f-99aad69d5133 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.698055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc078b-9e57-48b2-bf6f-99aad69d5133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.698521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc078b-9e57-48b2-bf6f-99aad69d5133 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.699282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc078b-9e57-48b2-bf6f-99aad69d5133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:25.702620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc078b-9e57-48b2-bf6f-99aad69d5133 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:25.749079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 919/1853] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:25 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:25.753020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c94fe-7196-4785-87ed-684cb54e6702 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:25.765354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c94fe-7196-4785-87ed-684cb54e6702 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:25.770042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93d66-9ad8-45fd-99f3-4d0a0aaed06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:25.770715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93d66-9ad8-45fd-99f3-4d0a0aaed06a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.770994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93d66-9ad8-45fd-99f3-4d0a0aaed06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.771407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93d66-9ad8-45fd-99f3-4d0a0aaed06a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.772167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa93d66-9ad8-45fd-99f3-4d0a0aaed06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:25.778925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa93d66-9ad8-45fd-99f3-4d0a0aaed06a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:25.783070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:25.800337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 935/1854] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:25.805425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc078b-9e57-48b2-bf6f-99aad69d5133 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:25.817557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc078b-9e57-48b2-bf6f-99aad69d5133 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:25.827337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98638eaf-bfb7-4ab0-9fb7-87fcea07e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:25.828568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638eaf-bfb7-4ab0-9fb7-87fcea07e6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.829249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638eaf-bfb7-4ab0-9fb7-87fcea07e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.829627 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98638eaf-bfb7-4ab0-9fb7-87fcea07e6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.831032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98638eaf-bfb7-4ab0-9fb7-87fcea07e6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:25.833684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98638eaf-bfb7-4ab0-9fb7-87fcea07e6c9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:25.849603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 920/1855] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:25.853712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93d66-9ad8-45fd-99f3-4d0a0aaed06a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:25.866745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93d66-9ad8-45fd-99f3-4d0a0aaed06a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:25.873389 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637be48b-24ea-404b-b862-8991f389464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:25.874285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637be48b-24ea-404b-b862-8991f389464c admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.874568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637be48b-24ea-404b-b862-8991f389464c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.874842 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637be48b-24ea-404b-b862-8991f389464c admin admin] PATH_INFO: `/v3/projects/aaa6826a13884cb18795c1c973265dc5/users/8e6896f74f2e48fbad1aae5e261f80cc/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.905683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637be48b-24ea-404b-b862-8991f389464c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa6826a13884cb18795c1c973265dc5, user_id=8e6896f74f2e48fbad1aae5e261f80cc, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:25.909370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637be48b-24ea-404b-b862-8991f389464c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:25.934924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 936/1856] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:25 2022] PUT /identity/v3/projects/aaa6826a13884cb18795c1c973265dc5/users/8e6896f74f2e48fbad1aae5e261f80cc/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:25.946151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24b1ea-2648-483a-9f5d-619821749880 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:25.946460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24b1ea-2648-483a-9f5d-619821749880 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:25.946719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24b1ea-2648-483a-9f5d-619821749880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:25.991390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637be48b-24ea-404b-b862-8991f389464c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:25.993590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-637be48b-24ea-404b-b862-8991f389464c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:25.995535 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fc24b1ea-2648-483a-9f5d-619821749880 None None] MFA Rules not processed for user `8e6896f74f2e48fbad1aae5e261f80cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:25.996971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fc24b1ea-2648-483a-9f5d-619821749880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:26.100834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637be48b-24ea-404b-b862-8991f389464c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:26.111981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:26.114536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:26.114877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:26.115227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] PATH_INFO: `/v3/projects/1c2bd54abb0c4b848caa285d56c3042d` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:26.119883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2bd54abb0c4b848caa285d56c3042d)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:26.122699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:26.131732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 921/1857] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:26.149954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24b1ea-2648-483a-9f5d-619821749880 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:26.152339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fc24b1ea-2648-483a-9f5d-619821749880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:26.210809 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:26.214554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2bd54abb0c4b848caa285d56c3042d', 'request_id': 'req-d19caab2-0155-4ff7-b317-84ede2cf7644'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.228142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2bd54abb0c4b848caa285d56c3042d', 'request_id': 'req-d19caab2-0155-4ff7-b317-84ede2cf7644'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.237997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2bd54abb0c4b848caa285d56c3042d', 'request_id': 'req-d19caab2-0155-4ff7-b317-84ede2cf7644'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.258415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24b1ea-2648-483a-9f5d-619821749880 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:26.258904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] The token cache is being invalidate because project 1c2bd54abb0c4b848caa285d56c3042d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:26.259289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.260249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.265021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 937/1858] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:25 2022] DELETE /identity/v3/projects/1c2bd54abb0c4b848caa285d56c3042d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:26.266787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:26.269030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:26.364489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19caab2-0155-4ff7-b317-84ede2cf7644 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:26.369144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfec27-ee43-43fa-baf9-27b2b7e6d53f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:26.370045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfec27-ee43-43fa-baf9-27b2b7e6d53f service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:26.370777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfec27-ee43-43fa-baf9-27b2b7e6d53f service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:26.371136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfec27-ee43-43fa-baf9-27b2b7e6d53f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:26.372349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:26.374413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3ddfec27-ee43-43fa-baf9-27b2b7e6d53f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:26.374699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:26.374996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:26.375281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] PATH_INFO: `/v3/users/60253557dc7140788abf19182b1cd67a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:26.377333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60253557dc7140788abf19182b1cd67a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:26.379371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:26.386640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:26.459549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfec27-ee43-43fa-baf9-27b2b7e6d53f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:26.460061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60253557dc7140788abf19182b1cd67a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.460516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60253557dc7140788abf19182b1cd67a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.461378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfec27-ee43-43fa-baf9-27b2b7e6d53f service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:26.474584 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 922/1859] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:26.484339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60253557dc7140788abf19182b1cd67a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.494006 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60253557dc7140788abf19182b1cd67a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.497954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfec27-ee43-43fa-baf9-27b2b7e6d53f service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:26.499427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3ddfec27-ee43-43fa-baf9-27b2b7e6d53f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:26.503108 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ba211fb-de85-4efd-940b-f1cdd1538723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60253557dc7140788abf19182b1cd67a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.519024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfec27-ee43-43fa-baf9-27b2b7e6d53f service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:26.524563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 938/1860] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:26 2022] DELETE /identity/v3/users/60253557dc7140788abf19182b1cd67a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:26.537637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:26.538837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:26.539283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:26.540255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] PATH_INFO: `/v3/users/8e6896f74f2e48fbad1aae5e261f80cc` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:26.542370 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6896f74f2e48fbad1aae5e261f80cc)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:26.544587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:26.608898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6896f74f2e48fbad1aae5e261f80cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.628226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6896f74f2e48fbad1aae5e261f80cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.638935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6896f74f2e48fbad1aae5e261f80cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.647224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6896f74f2e48fbad1aae5e261f80cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.647875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6896f74f2e48fbad1aae5e261f80cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.655141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 923/1861] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:26 2022] DELETE /identity/v3/users/8e6896f74f2e48fbad1aae5e261f80cc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:26.659512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add8293-ad54-4435-b33f-9bada27bbfd7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:26.659809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add8293-ad54-4435-b33f-9bada27bbfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:26.660125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add8293-ad54-4435-b33f-9bada27bbfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:26.685030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4add8293-ad54-4435-b33f-9bada27bbfd7 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:26.686348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4add8293-ad54-4435-b33f-9bada27bbfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:26.698001 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:26.699624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:26.718203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:26.763683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 939/1862] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:26.773692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add8293-ad54-4435-b33f-9bada27bbfd7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:26.776283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4add8293-ad54-4435-b33f-9bada27bbfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:26.785976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b02b10-238d-4aa5-a9d7-14c5f7768614 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:26.790987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:26.791863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:26.792173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:26.792667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] PATH_INFO: `/v3/users/e21d920404f542f196d023ceb9b4d193` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:26.793632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21d920404f542f196d023ceb9b4d193)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:26.795676 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:26.856858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21d920404f542f196d023ceb9b4d193'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.863847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add8293-ad54-4435-b33f-9bada27bbfd7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:26.867526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa40786-00b0-4356-b4ed-e93b685d47bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:26.868210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40786-00b0-4356-b4ed-e93b685d47bf service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:26.868489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40786-00b0-4356-b4ed-e93b685d47bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:26.868762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40786-00b0-4356-b4ed-e93b685d47bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:26.869871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21d920404f542f196d023ceb9b4d193'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.878944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21d920404f542f196d023ceb9b4d193'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.879288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa40786-00b0-4356-b4ed-e93b685d47bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:26.881086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa40786-00b0-4356-b4ed-e93b685d47bf service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:26.886537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21d920404f542f196d023ceb9b4d193'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.887238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21d920404f542f196d023ceb9b4d193'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:26.893647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 924/1864] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:26 2022] DELETE /identity/v3/users/e21d920404f542f196d023ceb9b4d193 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:26.893792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 940/1864] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:26.899468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:26.900266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3c91a-d792-4849-a015-9c2f7b5a029e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:26.900627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3c91a-d792-4849-a015-9c2f7b5a029e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:26.900977 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3c91a-d792-4849-a015-9c2f7b5a029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:26.901093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:26.923675 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9ba3c91a-d792-4849-a015-9c2f7b5a029e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:26.925010 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9ba3c91a-d792-4849-a015-9c2f7b5a029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:26.948789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:27.010152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 941/1865] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:27.013169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6906d0-2a91-4f38-b75a-2a94b6b65cc1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.018688 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.019740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.020378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.020495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] PATH_INFO: `/v3/projects/05df8ccee8884d1f93cdad808123145f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.020840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3c91a-d792-4849-a015-9c2f7b5a029e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:27.021738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=05df8ccee8884d1f93cdad808123145f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.022294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9ba3c91a-d792-4849-a015-9c2f7b5a029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.023830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.079126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:27.097056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05df8ccee8884d1f93cdad808123145f', 'request_id': 'req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.105421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05df8ccee8884d1f93cdad808123145f', 'request_id': 'req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.115727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05df8ccee8884d1f93cdad808123145f', 'request_id': 'req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.124289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3c91a-d792-4849-a015-9c2f7b5a029e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.140524 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] The token cache is being invalidate because project 05df8ccee8884d1f93cdad808123145f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:27.140957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.141939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9324a09-130d-4ffd-a78e-6fa36a5a25cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.143800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 925/1866] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:26 2022] DELETE /identity/v3/projects/05df8ccee8884d1f93cdad808123145f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:27.149191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934477d-43bd-4fa9-b0d3-3d77300d448b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.149486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934477d-43bd-4fa9-b0d3-3d77300d448b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.149835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934477d-43bd-4fa9-b0d3-3d77300d448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.175485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7934477d-43bd-4fa9-b0d3-3d77300d448b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:27.177150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7934477d-43bd-4fa9-b0d3-3d77300d448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.239584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59257d98-6d59-4a83-846a-8f48758f83af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.240291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59257d98-6d59-4a83-846a-8f48758f83af service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.240573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59257d98-6d59-4a83-846a-8f48758f83af service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.240906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59257d98-6d59-4a83-846a-8f48758f83af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.242693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-59257d98-6d59-4a83-846a-8f48758f83af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.273431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 926/1867] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:27.281259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717b01-a5ae-4ff6-a49f-5c5a4e402a1c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.282600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717b01-a5ae-4ff6-a49f-5c5a4e402a1c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.283056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717b01-a5ae-4ff6-a49f-5c5a4e402a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.313244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b6717b01-a5ae-4ff6-a49f-5c5a4e402a1c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:27.314501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b6717b01-a5ae-4ff6-a49f-5c5a4e402a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.325936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 927/1868] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:27.326970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6717b01-a5ae-4ff6-a49f-5c5a4e402a1c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:27.328343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b6717b01-a5ae-4ff6-a49f-5c5a4e402a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.340271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6717b01-a5ae-4ff6-a49f-5c5a4e402a1c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.344731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59257d98-6d59-4a83-846a-8f48758f83af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.345378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.346320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59257d98-6d59-4a83-846a-8f48758f83af service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.346730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.347020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.347326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] PATH_INFO: `/v3/projects/aaa6826a13884cb18795c1c973265dc5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.348578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa6826a13884cb18795c1c973265dc5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.350673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.376585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 942/1869] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:27.378219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59257d98-6d59-4a83-846a-8f48758f83af service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:27.390017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59257d98-6d59-4a83-846a-8f48758f83af service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.395826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3e0ae-4b30-49f2-8504-5beaa5cfebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.396620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3e0ae-4b30-49f2-8504-5beaa5cfebf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.396991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3e0ae-4b30-49f2-8504-5beaa5cfebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.397319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3e0ae-4b30-49f2-8504-5beaa5cfebf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.398479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3e0ae-4b30-49f2-8504-5beaa5cfebf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:27.398880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3e0ae-4b30-49f2-8504-5beaa5cfebf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.401137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3e0ae-4b30-49f2-8504-5beaa5cfebf8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.415407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa6826a13884cb18795c1c973265dc5', 'request_id': 'req-a83da70d-b353-4535-8dea-abf35f8fa1eb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.419834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 943/1870] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:27.421027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3e0ae-4b30-49f2-8504-5beaa5cfebf8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:27.425330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa6826a13884cb18795c1c973265dc5', 'request_id': 'req-a83da70d-b353-4535-8dea-abf35f8fa1eb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.432962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa6826a13884cb18795c1c973265dc5', 'request_id': 'req-a83da70d-b353-4535-8dea-abf35f8fa1eb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.437231 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3e0ae-4b30-49f2-8504-5beaa5cfebf8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.456657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] The token cache is being invalidate because project aaa6826a13884cb18795c1c973265dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:27.457961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.458662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a83da70d-b353-4535-8dea-abf35f8fa1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.461561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 928/1871] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:27 2022] DELETE /identity/v3/projects/aaa6826a13884cb18795c1c973265dc5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:27.469373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818282c-e6cc-4c58-95b8-1a3d4815d3d8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.469931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818282c-e6cc-4c58-95b8-1a3d4815d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.470258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818282c-e6cc-4c58-95b8-1a3d4815d3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.487799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:27.499264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4818282c-e6cc-4c58-95b8-1a3d4815d3d8 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:27.501123 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4818282c-e6cc-4c58-95b8-1a3d4815d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.547906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc89cc-43b8-4938-8f54-32a3d397c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.548537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:27.549267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc89cc-43b8-4938-8f54-32a3d397c0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.549386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc89cc-43b8-4938-8f54-32a3d397c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.549610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc89cc-43b8-4938-8f54-32a3d397c0b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.550582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc89cc-43b8-4938-8f54-32a3d397c0b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.552927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc89cc-43b8-4938-8f54-32a3d397c0b8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.588753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 944/1872] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:27 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:27.589845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 929/1873] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:27.597294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc89cc-43b8-4938-8f54-32a3d397c0b8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:27.598529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca6025-53a9-4492-ae5a-9bc5db6b09fa None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.598829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca6025-53a9-4492-ae5a-9bc5db6b09fa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.598929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c7dc89cc-43b8-4938-8f54-32a3d397c0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.599228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca6025-53a9-4492-ae5a-9bc5db6b09fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.621320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-aaca6025-53a9-4492-ae5a-9bc5db6b09fa None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:27.623068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-aaca6025-53a9-4492-ae5a-9bc5db6b09fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.675189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc89cc-43b8-4938-8f54-32a3d397c0b8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.682598 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24c741-1bf9-46c3-8809-c2542efa282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.683330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24c741-1bf9-46c3-8809-c2542efa282f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.683673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24c741-1bf9-46c3-8809-c2542efa282f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.683952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24c741-1bf9-46c3-8809-c2542efa282f admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.685102 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24c741-1bf9-46c3-8809-c2542efa282f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.687256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24c741-1bf9-46c3-8809-c2542efa282f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.705348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 930/1874] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:27.706213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca6025-53a9-4492-ae5a-9bc5db6b09fa None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:27.707549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-aaca6025-53a9-4492-ae5a-9bc5db6b09fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.717542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 945/1875] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:27 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:27.717542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24c741-1bf9-46c3-8809-c2542efa282f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:27.719978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca6025-53a9-4492-ae5a-9bc5db6b09fa None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.725387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.726271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.726598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.726818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] PATH_INFO: `/v3/projects/385381b464504136b104d04d47c7f872` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.728068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385381b464504136b104d04d47c7f872)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.728344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24c741-1bf9-46c3-8809-c2542efa282f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.730655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.735196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397c613-2076-4766-962e-49dfe2520f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.735916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397c613-2076-4766-962e-49dfe2520f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.736799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397c613-2076-4766-962e-49dfe2520f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.737079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397c613-2076-4766-962e-49dfe2520f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.738071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397c613-2076-4766-962e-49dfe2520f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:27.739080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397c613-2076-4766-962e-49dfe2520f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.740845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397c613-2076-4766-962e-49dfe2520f2e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.756823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 946/1876] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:27.761570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397c613-2076-4766-962e-49dfe2520f2e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:27.778706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397c613-2076-4766-962e-49dfe2520f2e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.796986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385381b464504136b104d04d47c7f872', 'request_id': 'req-10512738-c6bc-4878-8ab7-650b07e70c30'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.805785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385381b464504136b104d04d47c7f872', 'request_id': 'req-10512738-c6bc-4878-8ab7-650b07e70c30'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.814396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385381b464504136b104d04d47c7f872', 'request_id': 'req-10512738-c6bc-4878-8ab7-650b07e70c30'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.836237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] The token cache is being invalidate because project 385381b464504136b104d04d47c7f872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:27.836565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.837498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.839460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 931/1877] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:27 2022] DELETE /identity/v3/projects/385381b464504136b104d04d47c7f872 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:27.844336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:27.845784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.855116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d178f-1828-4357-bafe-fecd0360f4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.855810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d178f-1828-4357-bafe-fecd0360f4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.856130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d178f-1828-4357-bafe-fecd0360f4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.856661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d178f-1828-4357-bafe-fecd0360f4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.857407 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d178f-1828-4357-bafe-fecd0360f4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.859048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d178f-1828-4357-bafe-fecd0360f4ed admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.871629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 947/1878] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:27.873530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d178f-1828-4357-bafe-fecd0360f4ed admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:27.875317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eb1d178f-1828-4357-bafe-fecd0360f4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:27.891403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d178f-1828-4357-bafe-fecd0360f4ed admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.898346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.899289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.899660 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.899941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] PATH_INFO: `/v3/users/253e6803905b48f6885e6d6d17e2f75c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.901631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=253e6803905b48f6885e6d6d17e2f75c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.904465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.920742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:27.932198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10512738-c6bc-4878-8ab7-650b07e70c30 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:27.939072 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d4fc4-5bb5-495f-ad71-dd53daee3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:27.939984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d4fc4-5bb5-495f-ad71-dd53daee3827 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:27.940306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d4fc4-5bb5-495f-ad71-dd53daee3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:27.940646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d4fc4-5bb5-495f-ad71-dd53daee3827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:27.941649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d4fc4-5bb5-495f-ad71-dd53daee3827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:27.944413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d4fc4-5bb5-495f-ad71-dd53daee3827 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:27.961603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:27.978865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253e6803905b48f6885e6d6d17e2f75c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:27.980106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253e6803905b48f6885e6d6d17e2f75c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:28.004989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253e6803905b48f6885e6d6d17e2f75c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:28.006030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253e6803905b48f6885e6d6d17e2f75c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:28.007692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 932/1879] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:27 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:28.008798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d4fc4-5bb5-495f-ad71-dd53daee3827 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.011276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-666d4fc4-5bb5-495f-ad71-dd53daee3827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:28.020572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253e6803905b48f6885e6d6d17e2f75c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:28.052465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 948/1880] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:27 2022] DELETE /identity/v3/users/253e6803905b48f6885e6d6d17e2f75c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:28.053857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.055612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:28.148885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d4fc4-5bb5-495f-ad71-dd53daee3827 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.151483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408611bc-f0c3-42e3-9eec-44f5b4a4cfa2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.156951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fde7c4-9025-4d65-bf5e-5f60a438087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.157186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844fcb-1758-4716-a294-b42cb577c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.157925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844fcb-1758-4716-a294-b42cb577c6ff admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.158238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fde7c4-9025-4d65-bf5e-5f60a438087a admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.158339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844fcb-1758-4716-a294-b42cb577c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.158662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844fcb-1758-4716-a294-b42cb577c6ff admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.158974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fde7c4-9025-4d65-bf5e-5f60a438087a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.159567 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71844fcb-1758-4716-a294-b42cb577c6ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.159928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fde7c4-9025-4d65-bf5e-5f60a438087a admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.161024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fde7c4-9025-4d65-bf5e-5f60a438087a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.161676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71844fcb-1758-4716-a294-b42cb577c6ff admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.162938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fde7c4-9025-4d65-bf5e-5f60a438087a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.183562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 933/1881] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:28.189359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fde7c4-9025-4d65-bf5e-5f60a438087a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.201604 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fde7c4-9025-4d65-bf5e-5f60a438087a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.207660 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 949/1882] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:28 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:28.208196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edd06a-0a51-4c58-8c28-393481ba4b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.209710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edd06a-0a51-4c58-8c28-393481ba4b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.209998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edd06a-0a51-4c58-8c28-393481ba4b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.210284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edd06a-0a51-4c58-8c28-393481ba4b3a admin admin] PATH_INFO: `/v3/projects/53ecf3b022e04ad8a43f3316c03a469b/users/e204972a11e14a16bc70e8d348514581/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.213344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844fcb-1758-4716-a294-b42cb577c6ff admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.224806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844fcb-1758-4716-a294-b42cb577c6ff admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.227488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edd06a-0a51-4c58-8c28-393481ba4b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ecf3b022e04ad8a43f3316c03a469b, user_id=e204972a11e14a16bc70e8d348514581, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.231912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b948b65-ae32-4006-84ed-ea6d34e36df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.231912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b948b65-ae32-4006-84ed-ea6d34e36df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.231912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b948b65-ae32-4006-84ed-ea6d34e36df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.231912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b948b65-ae32-4006-84ed-ea6d34e36df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.232216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b948b65-ae32-4006-84ed-ea6d34e36df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.234386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b948b65-ae32-4006-84ed-ea6d34e36df8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.236505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edd06a-0a51-4c58-8c28-393481ba4b3a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.248200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 950/1883] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:28.253218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b948b65-ae32-4006-84ed-ea6d34e36df8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.267967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b948b65-ae32-4006-84ed-ea6d34e36df8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.283616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 934/1884] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:28 2022] PUT /identity/v3/projects/53ecf3b022e04ad8a43f3316c03a469b/users/e204972a11e14a16bc70e8d348514581/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:28.285812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0202-fdfb-4b26-81eb-e80a773398a6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.286119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0202-fdfb-4b26-81eb-e80a773398a6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.286384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0202-fdfb-4b26-81eb-e80a773398a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.331183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-720e0202-fdfb-4b26-81eb-e80a773398a6 None None] MFA Rules not processed for user `e204972a11e14a16bc70e8d348514581`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:28.333373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-720e0202-fdfb-4b26-81eb-e80a773398a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:28.395363 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f406f-f09e-4dd7-8e6d-04ab8f186636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.396120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f406f-f09e-4dd7-8e6d-04ab8f186636 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.396515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f406f-f09e-4dd7-8e6d-04ab8f186636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.396803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f406f-f09e-4dd7-8e6d-04ab8f186636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.398080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f406f-f09e-4dd7-8e6d-04ab8f186636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.399977 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f406f-f09e-4dd7-8e6d-04ab8f186636 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.415740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 951/1885] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:28.417127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f406f-f09e-4dd7-8e6d-04ab8f186636 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.427485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:28.436229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f406f-f09e-4dd7-8e6d-04ab8f186636 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.443475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e0a9f-d8ef-483d-9077-e8d6756c5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.444037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 935/1886] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:28.445297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e0a9f-d8ef-483d-9077-e8d6756c5d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.445854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e0a9f-d8ef-483d-9077-e8d6756c5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.446221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e0a9f-d8ef-483d-9077-e8d6756c5d81 admin admin] PATH_INFO: `/v3/projects/e516a5843f8f48488a277aafcffde753/users/382e7f0bbaf74ed68812c061565f8713/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.448451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0202-fdfb-4b26-81eb-e80a773398a6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.460397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0202-fdfb-4b26-81eb-e80a773398a6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.465090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39080769-dbbb-4c4a-bdd8-f04e8df13fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.466892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e0a9f-d8ef-483d-9077-e8d6756c5d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e516a5843f8f48488a277aafcffde753, user_id=382e7f0bbaf74ed68812c061565f8713, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.467006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39080769-dbbb-4c4a-bdd8-f04e8df13fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.467006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39080769-dbbb-4c4a-bdd8-f04e8df13fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.467006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39080769-dbbb-4c4a-bdd8-f04e8df13fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.467239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39080769-dbbb-4c4a-bdd8-f04e8df13fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.469468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39080769-dbbb-4c4a-bdd8-f04e8df13fe8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.470305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e0a9f-d8ef-483d-9077-e8d6756c5d81 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.498075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 952/1887] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:28 2022] PUT /identity/v3/projects/e516a5843f8f48488a277aafcffde753/users/382e7f0bbaf74ed68812c061565f8713/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:28.504347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 936/1888] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:28 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:28.512262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d153-8023-4cf3-99a1-4be20f0524de None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.512979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d153-8023-4cf3-99a1-4be20f0524de None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.513136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39080769-dbbb-4c4a-bdd8-f04e8df13fe8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.513595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301d153-8023-4cf3-99a1-4be20f0524de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.557430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6301d153-8023-4cf3-99a1-4be20f0524de None None] MFA Rules not processed for user `382e7f0bbaf74ed68812c061565f8713`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:28.558516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6301d153-8023-4cf3-99a1-4be20f0524de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:28.575008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:28.632281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39080769-dbbb-4c4a-bdd8-f04e8df13fe8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.639239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13ca61-f181-493b-afd9-0c659a999ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.639989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13ca61-f181-493b-afd9-0c659a999ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.641225 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13ca61-f181-493b-afd9-0c659a999ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.641597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13ca61-f181-493b-afd9-0c659a999ecc admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.642701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13ca61-f181-493b-afd9-0c659a999ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.644954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13ca61-f181-493b-afd9-0c659a999ecc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.665613 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 953/1889] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:28.666877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301d153-8023-4cf3-99a1-4be20f0524de None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.668244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6301d153-8023-4cf3-99a1-4be20f0524de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:28.677197 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 937/1890] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:28 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:28.678144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13ca61-f181-493b-afd9-0c659a999ecc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.680085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-be13ca61-f181-493b-afd9-0c659a999ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:28.684353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301d153-8023-4cf3-99a1-4be20f0524de None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.689667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.690557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.690842 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.691118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] PATH_INFO: `/v3/projects/4a37d56163ac412abdfca2bef35c62b4` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.692346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a37d56163ac412abdfca2bef35c62b4)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.694626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.757527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a37d56163ac412abdfca2bef35c62b4', 'request_id': 'req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:28.757889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13ca61-f181-493b-afd9-0c659a999ecc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.767152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a37d56163ac412abdfca2bef35c62b4', 'request_id': 'req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:28.775294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a37d56163ac412abdfca2bef35c62b4', 'request_id': 'req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:28.788583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] The token cache is being invalidate because project 4a37d56163ac412abdfca2bef35c62b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:28.789304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:28.790575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:28.797322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 954/1891] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:28 2022] DELETE /identity/v3/projects/4a37d56163ac412abdfca2bef35c62b4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:28.798641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.800387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:28.809239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce5111-713a-470e-97e8-7f7d87078ef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.810065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5111-713a-470e-97e8-7f7d87078ef6 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.810222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5111-713a-470e-97e8-7f7d87078ef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.810523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce5111-713a-470e-97e8-7f7d87078ef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.812425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-49ce5111-713a-470e-97e8-7f7d87078ef6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:28.852968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:28.865677 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f9ab9-fc1e-4f37-9af0-0e6fdc37b28f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.871126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bee29-1125-4ec8-83da-95eb4c295a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.871734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce5111-713a-470e-97e8-7f7d87078ef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.871838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bee29-1125-4ec8-83da-95eb4c295a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.872294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bee29-1125-4ec8-83da-95eb4c295a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.872598 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bee29-1125-4ec8-83da-95eb4c295a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.873285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce5111-713a-470e-97e8-7f7d87078ef6 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.873459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bee29-1125-4ec8-83da-95eb4c295a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.875073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bee29-1125-4ec8-83da-95eb4c295a79 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.882539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 938/1892] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:28.884105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c98af-e04d-482e-adc6-b788b4f4a013 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.884338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c98af-e04d-482e-adc6-b788b4f4a013 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.884615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c98af-e04d-482e-adc6-b788b4f4a013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.885429 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 955/1893] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:28.889762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bee29-1125-4ec8-83da-95eb4c295a79 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.899718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bee29-1125-4ec8-83da-95eb4c295a79 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:28.904541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1778d2-8d70-4d58-89d9-1562f827559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:28.905460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1778d2-8d70-4d58-89d9-1562f827559d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.905891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1778d2-8d70-4d58-89d9-1562f827559d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.906313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1778d2-8d70-4d58-89d9-1562f827559d admin admin] PATH_INFO: `/v3/projects/10ae281aa5884500a693479e1a912445/users/18b2caa98275467faccae825a095e632/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.910511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1c6c98af-e04d-482e-adc6-b788b4f4a013 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:28.911860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1c6c98af-e04d-482e-adc6-b788b4f4a013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:28.924064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 939/1894] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:28.929570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1778d2-8d70-4d58-89d9-1562f827559d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ae281aa5884500a693479e1a912445, user_id=18b2caa98275467faccae825a095e632, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:28.932113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd11a91-ec0e-42ea-8b83-7caa46cfe14b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:28.932399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1778d2-8d70-4d58-89d9-1562f827559d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:28.932525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd11a91-ec0e-42ea-8b83-7caa46cfe14b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:28.932757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd11a91-ec0e-42ea-8b83-7caa46cfe14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:28.954417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 956/1895] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:28 2022] PUT /identity/v3/projects/10ae281aa5884500a693479e1a912445/users/18b2caa98275467faccae825a095e632/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:28.955737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-abd11a91-ec0e-42ea-8b83-7caa46cfe14b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:28.957012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-abd11a91-ec0e-42ea-8b83-7caa46cfe14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:28.958238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1778d2-8d70-4d58-89d9-1562f827559d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:28.975647 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:29.024219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1778d2-8d70-4d58-89d9-1562f827559d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.027052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 940/1896] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:29.031711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd11a91-ec0e-42ea-8b83-7caa46cfe14b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.033389 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568da68a-b515-4f1e-acb0-706909245e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.034076 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568da68a-b515-4f1e-acb0-706909245e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.034696 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568da68a-b515-4f1e-acb0-706909245e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.034696 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568da68a-b515-4f1e-acb0-706909245e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.035403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568da68a-b515-4f1e-acb0-706909245e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.037151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568da68a-b515-4f1e-acb0-706909245e34 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.042581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd11a91-ec0e-42ea-8b83-7caa46cfe14b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.048503 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807395e-b285-401b-890d-818eb22917ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.052045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 957/1897] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:29:29.052171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807395e-b285-401b-890d-818eb22917ca admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.052171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807395e-b285-401b-890d-818eb22917ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.052171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807395e-b285-401b-890d-818eb22917ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.052171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807395e-b285-401b-890d-818eb22917ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:29.052171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807395e-b285-401b-890d-818eb22917ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.052798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807395e-b285-401b-890d-818eb22917ca admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.054039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568da68a-b515-4f1e-acb0-706909245e34 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.066732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568da68a-b515-4f1e-acb0-706909245e34 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.068687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 941/1898] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:29:29.071502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08afd2-6411-4b81-a7d9-48045c80c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.071661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807395e-b285-401b-890d-818eb22917ca admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.072469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08afd2-6411-4b81-a7d9-48045c80c08f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.072745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08afd2-6411-4b81-a7d9-48045c80c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.073028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08afd2-6411-4b81-a7d9-48045c80c08f admin admin] PATH_INFO: `/v3/projects/10ae281aa5884500a693479e1a912445/users/18b2caa98275467faccae825a095e632/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.075367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08afd2-6411-4b81-a7d9-48045c80c08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ae281aa5884500a693479e1a912445, user_id=18b2caa98275467faccae825a095e632, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.079011 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08afd2-6411-4b81-a7d9-48045c80c08f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.083764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807395e-b285-401b-890d-818eb22917ca admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.091351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 958/1899] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:29 2022] PUT /identity/v3/projects/10ae281aa5884500a693479e1a912445/users/18b2caa98275467faccae825a095e632/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:29.103191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de506362-89d4-4325-9b13-1eb90dd01bd4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.103911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de506362-89d4-4325-9b13-1eb90dd01bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.104223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de506362-89d4-4325-9b13-1eb90dd01bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.138609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-de506362-89d4-4325-9b13-1eb90dd01bd4 None None] MFA Rules not processed for user `18b2caa98275467faccae825a095e632`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:29.139935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-de506362-89d4-4325-9b13-1eb90dd01bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:29.167318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf532e91-52ee-4af0-ac34-49ac2e01bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.168371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf532e91-52ee-4af0-ac34-49ac2e01bb5b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.168893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf532e91-52ee-4af0-ac34-49ac2e01bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.169489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf532e91-52ee-4af0-ac34-49ac2e01bb5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.170207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf532e91-52ee-4af0-ac34-49ac2e01bb5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.172666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf532e91-52ee-4af0-ac34-49ac2e01bb5b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.206881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 942/1900] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:29 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:29.208696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf532e91-52ee-4af0-ac34-49ac2e01bb5b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.231342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 959/1901] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:29.243770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de506362-89d4-4325-9b13-1eb90dd01bd4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.245486 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-de506362-89d4-4325-9b13-1eb90dd01bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:29.278506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf532e91-52ee-4af0-ac34-49ac2e01bb5b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.282673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:29.290719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c830e9-0ef2-4c06-b4aa-041d19c05190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.291613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c830e9-0ef2-4c06-b4aa-041d19c05190 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.292209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c830e9-0ef2-4c06-b4aa-041d19c05190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.292558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c830e9-0ef2-4c06-b4aa-041d19c05190 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.293876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c830e9-0ef2-4c06-b4aa-041d19c05190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.296426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c830e9-0ef2-4c06-b4aa-041d19c05190 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.313942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de506362-89d4-4325-9b13-1eb90dd01bd4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.324724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 943/1902] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:29 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:29.325844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c830e9-0ef2-4c06-b4aa-041d19c05190 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.335218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c830e9-0ef2-4c06-b4aa-041d19c05190 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.340160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b70c9-bc1e-4147-b122-233436541fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.341381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b70c9-bc1e-4147-b122-233436541fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.341663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b70c9-bc1e-4147-b122-233436541fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.342055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b70c9-bc1e-4147-b122-233436541fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.342743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b70c9-bc1e-4147-b122-233436541fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.344582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b70c9-bc1e-4147-b122-233436541fd3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.354403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 944/1903] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:29:29.358956 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b70c9-bc1e-4147-b122-233436541fd3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.362425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57615f75-7eba-4a59-aa83-f21aaddcbc44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.363093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57615f75-7eba-4a59-aa83-f21aaddcbc44 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.363373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57615f75-7eba-4a59-aa83-f21aaddcbc44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.363648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57615f75-7eba-4a59-aa83-f21aaddcbc44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.368645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b70c9-bc1e-4147-b122-233436541fd3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.373509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70466364-72b6-4c1c-b9bb-590b1ef0f429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.374182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70466364-72b6-4c1c-b9bb-590b1ef0f429 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.374465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70466364-72b6-4c1c-b9bb-590b1ef0f429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.374735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70466364-72b6-4c1c-b9bb-590b1ef0f429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.375465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70466364-72b6-4c1c-b9bb-590b1ef0f429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.377119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70466364-72b6-4c1c-b9bb-590b1ef0f429 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.388866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 945/1904] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:29.392953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70466364-72b6-4c1c-b9bb-590b1ef0f429 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.398906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:29.404270 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70466364-72b6-4c1c-b9bb-590b1ef0f429 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.412215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c44a-6535-4630-82c5-653a82c01786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.413130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c44a-6535-4630-82c5-653a82c01786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.413412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c44a-6535-4630-82c5-653a82c01786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.413690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c44a-6535-4630-82c5-653a82c01786 admin admin] PATH_INFO: `/v3/projects/02375af1c44644719899bff62b315ff3/users/4ffeded5ad5d4172b0378d2aacbbccc6/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.431462 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c44a-6535-4630-82c5-653a82c01786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02375af1c44644719899bff62b315ff3, user_id=4ffeded5ad5d4172b0378d2aacbbccc6, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.434936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c44a-6535-4630-82c5-653a82c01786 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.445246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57615f75-7eba-4a59-aa83-f21aaddcbc44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.447002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57615f75-7eba-4a59-aa83-f21aaddcbc44 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.451094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 946/1905] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:29 2022] PUT /identity/v3/projects/02375af1c44644719899bff62b315ff3/users/4ffeded5ad5d4172b0378d2aacbbccc6/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:29.461408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647555bb-1549-4a5f-af03-b9847cd858ca None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.461696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647555bb-1549-4a5f-af03-b9847cd858ca None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.461973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 960/1906] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:29.463807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647555bb-1549-4a5f-af03-b9847cd858ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.492743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-647555bb-1549-4a5f-af03-b9847cd858ca None None] MFA Rules not processed for user `4ffeded5ad5d4172b0378d2aacbbccc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:29.493982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-647555bb-1549-4a5f-af03-b9847cd858ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:29.577350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57615f75-7eba-4a59-aa83-f21aaddcbc44 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.581517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 947/1907] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:29.585836 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647555bb-1549-4a5f-af03-b9847cd858ca None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.586765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57615f75-7eba-4a59-aa83-f21aaddcbc44 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.644207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6eee51-3a9c-4895-acec-2a3c668731f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.644870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6eee51-3a9c-4895-acec-2a3c668731f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.645150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6eee51-3a9c-4895-acec-2a3c668731f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.645427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6eee51-3a9c-4895-acec-2a3c668731f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.648360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bc6eee51-3a9c-4895-acec-2a3c668731f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:29.662025 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647555bb-1549-4a5f-af03-b9847cd858ca None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.671864 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfb7f5-d7dd-48c8-96c0-4ccef0328d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.672583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb7f5-d7dd-48c8-96c0-4ccef0328d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.672871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb7f5-d7dd-48c8-96c0-4ccef0328d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.673302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb7f5-d7dd-48c8-96c0-4ccef0328d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.674011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfb7f5-d7dd-48c8-96c0-4ccef0328d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.676025 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfb7f5-d7dd-48c8-96c0-4ccef0328d88 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.704767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:29.707366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 948/1908] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:29 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:29.708797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6eee51-3a9c-4895-acec-2a3c668731f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.710879 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6eee51-3a9c-4895-acec-2a3c668731f3 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.711370 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfb7f5-d7dd-48c8-96c0-4ccef0328d88 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.720453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 961/1909] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:29.766902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:29.783666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfb7f5-d7dd-48c8-96c0-4ccef0328d88 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.790558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d107fa-f99a-46f5-b45f-9b30efb5572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.791498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d107fa-f99a-46f5-b45f-9b30efb5572f admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.791781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d107fa-f99a-46f5-b45f-9b30efb5572f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.792090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d107fa-f99a-46f5-b45f-9b30efb5572f admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.792818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d107fa-f99a-46f5-b45f-9b30efb5572f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.795248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d107fa-f99a-46f5-b45f-9b30efb5572f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.820689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 949/1910] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:29 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:29.825087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6eee51-3a9c-4895-acec-2a3c668731f3 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.855483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6eee51-3a9c-4895-acec-2a3c668731f3 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.864421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8f48c-1fbb-421a-afb1-a0b93fea5f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.865406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8f48c-1fbb-421a-afb1-a0b93fea5f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.866367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8f48c-1fbb-421a-afb1-a0b93fea5f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.866664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8f48c-1fbb-421a-afb1-a0b93fea5f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.867502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8f48c-1fbb-421a-afb1-a0b93fea5f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.869872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8f48c-1fbb-421a-afb1-a0b93fea5f6c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.887834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 962/1911] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:29.888822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d107fa-f99a-46f5-b45f-9b30efb5572f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.905143 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d107fa-f99a-46f5-b45f-9b30efb5572f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:29.910516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e12d1-ca17-47d9-9187-94bc5a5a4a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:29.911438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e12d1-ca17-47d9-9187-94bc5a5a4a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:29.911845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e12d1-ca17-47d9-9187-94bc5a5a4a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:29.912177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e12d1-ca17-47d9-9187-94bc5a5a4a64 admin admin] PATH_INFO: `/v3/projects/4ea8677c9c27420eb5556affc5526cec/users/3b9272cef81442ae82624b440d125338/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:29.929832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e12d1-ca17-47d9-9187-94bc5a5a4a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea8677c9c27420eb5556affc5526cec, user_id=3b9272cef81442ae82624b440d125338, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:29.933138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e12d1-ca17-47d9-9187-94bc5a5a4a64 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:29.956100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 950/1912] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:29 2022] PUT /identity/v3/projects/4ea8677c9c27420eb5556affc5526cec/users/3b9272cef81442ae82624b440d125338/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:29.960218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8f48c-1fbb-421a-afb1-a0b93fea5f6c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:29.973707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8f48c-1fbb-421a-afb1-a0b93fea5f6c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:30.053090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7592a4-84cf-48a2-897a-61ea58f9d622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:30.053778 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7592a4-84cf-48a2-897a-61ea58f9d622 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:30.054063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7592a4-84cf-48a2-897a-61ea58f9d622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:30.054341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7592a4-84cf-48a2-897a-61ea58f9d622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:30.055095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7592a4-84cf-48a2-897a-61ea58f9d622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:30.056711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7592a4-84cf-48a2-897a-61ea58f9d622 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:30.071999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 963/1913] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:30.076256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e12d1-ca17-47d9-9187-94bc5a5a4a64 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:30.102287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e12d1-ca17-47d9-9187-94bc5a5a4a64 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:30.117012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9e233-2a0f-4f05-ac73-6e0c35e60b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:30.117997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9e233-2a0f-4f05-ac73-6e0c35e60b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:30.118295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9e233-2a0f-4f05-ac73-6e0c35e60b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:30.118595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9e233-2a0f-4f05-ac73-6e0c35e60b27 admin admin] PATH_INFO: `/v3/projects/4ea8677c9c27420eb5556affc5526cec/users/3b9272cef81442ae82624b440d125338/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:30.126668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9e233-2a0f-4f05-ac73-6e0c35e60b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea8677c9c27420eb5556affc5526cec, user_id=3b9272cef81442ae82624b440d125338, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:30.128339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9e233-2a0f-4f05-ac73-6e0c35e60b27 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:30.146814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 951/1914] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:30 2022] PUT /identity/v3/projects/4ea8677c9c27420eb5556affc5526cec/users/3b9272cef81442ae82624b440d125338/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:30.158062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb6a7-27c0-4272-ab3d-49bdc5a6c9fb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:30.158571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb6a7-27c0-4272-ab3d-49bdc5a6c9fb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:30.159169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb6a7-27c0-4272-ab3d-49bdc5a6c9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:30.196625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bc7bb6a7-27c0-4272-ab3d-49bdc5a6c9fb None None] MFA Rules not processed for user `3b9272cef81442ae82624b440d125338`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:30.198844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bc7bb6a7-27c0-4272-ab3d-49bdc5a6c9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:30.322584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 964/1915] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:30.336363 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9e233-2a0f-4f05-ac73-6e0c35e60b27 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:30.338434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-86c9e233-2a0f-4f05-ac73-6e0c35e60b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:30.409541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9e233-2a0f-4f05-ac73-6e0c35e60b27 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:30.413287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaebb9-b7d2-4bd4-a6a2-6d3c1da2f6f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:30.413947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaebb9-b7d2-4bd4-a6a2-6d3c1da2f6f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:30.414234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaebb9-b7d2-4bd4-a6a2-6d3c1da2f6f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:30.414509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaebb9-b7d2-4bd4-a6a2-6d3c1da2f6f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:30.424345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaebb9-b7d2-4bd4-a6a2-6d3c1da2f6f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:30.425796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaebb9-b7d2-4bd4-a6a2-6d3c1da2f6f8 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:30.435621 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 952/1916] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:30.463352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb6a7-27c0-4272-ab3d-49bdc5a6c9fb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:30.525934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb6a7-27c0-4272-ab3d-49bdc5a6c9fb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:30.530590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:30.531477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:30.531759 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:30.532057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] PATH_INFO: `/v3/users/4ffeded5ad5d4172b0378d2aacbbccc6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:30.533258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffeded5ad5d4172b0378d2aacbbccc6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:30.535201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:30.539722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:30.589616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffeded5ad5d4172b0378d2aacbbccc6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:30.590323 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffeded5ad5d4172b0378d2aacbbccc6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:30.602476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffeded5ad5d4172b0378d2aacbbccc6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:30.603172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffeded5ad5d4172b0378d2aacbbccc6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:30.610275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffeded5ad5d4172b0378d2aacbbccc6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:30.626141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 965/1917] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:30 2022] DELETE /identity/v3/users/4ffeded5ad5d4172b0378d2aacbbccc6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:30.630923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef2071-a83f-468f-9526-d20dbadf4cb5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:30.631421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef2071-a83f-468f-9526-d20dbadf4cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:30.631512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef2071-a83f-468f-9526-d20dbadf4cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:30.650500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f3ef2071-a83f-468f-9526-d20dbadf4cb5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:30.651737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f3ef2071-a83f-468f-9526-d20dbadf4cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:30.725803 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 953/1918] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:30.735887 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:30.737362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:30.794424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f5fb-b746-47c1-9dd8-71029d0bd189 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:30.798482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bbc30-9e43-4996-a900-68c4425bbb34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:30.799153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bbc30-9e43-4996-a900-68c4425bbb34 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:30.799447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bbc30-9e43-4996-a900-68c4425bbb34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:30.799716 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bbc30-9e43-4996-a900-68c4425bbb34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:30.809289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bbc30-9e43-4996-a900-68c4425bbb34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:30.811100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bbc30-9e43-4996-a900-68c4425bbb34 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:30.820713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 966/1919] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:31.093459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef2071-a83f-468f-9526-d20dbadf4cb5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:31.095099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f3ef2071-a83f-468f-9526-d20dbadf4cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:31.132895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef2071-a83f-468f-9526-d20dbadf4cb5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:31.138422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:31.139415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:31.139761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:31.140164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] PATH_INFO: `/v3/projects/02375af1c44644719899bff62b315ff3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:31.141451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=02375af1c44644719899bff62b315ff3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:31.143482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:31.189693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:31.193904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02375af1c44644719899bff62b315ff3', 'request_id': 'req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.200765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02375af1c44644719899bff62b315ff3', 'request_id': 'req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.207219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02375af1c44644719899bff62b315ff3', 'request_id': 'req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.221452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] The token cache is being invalidate because project 02375af1c44644719899bff62b315ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:31.221886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.222502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.224294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 954/1920] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:31 2022] DELETE /identity/v3/projects/02375af1c44644719899bff62b315ff3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:31.228273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bbc30-9e43-4996-a900-68c4425bbb34 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:31.243545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bbc30-9e43-4996-a900-68c4425bbb34 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:31.303070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:31.303967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:31.304283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:31.304561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] PATH_INFO: `/v3/users/3b9272cef81442ae82624b440d125338` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:31.305834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9272cef81442ae82624b440d125338)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:31.307783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:31.340891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:31.364165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9272cef81442ae82624b440d125338'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.365862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9272cef81442ae82624b440d125338'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.378531 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9272cef81442ae82624b440d125338'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.379266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9272cef81442ae82624b440d125338'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.388482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c728697b-5bba-4639-a8d2-468357df3190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9272cef81442ae82624b440d125338'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.403376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 967/1921] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:31 2022] DELETE /identity/v3/users/3b9272cef81442ae82624b440d125338 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:31.677227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:31.678738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:31.691842 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7a9f3-2d48-4c12-a437-d9af49b7bc0c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:31.750496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:31.751377 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:31.751660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:31.751929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] PATH_INFO: `/v3/projects/4ea8677c9c27420eb5556affc5526cec` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:31.753147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea8677c9c27420eb5556affc5526cec)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:31.755095 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:31.802143 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea8677c9c27420eb5556affc5526cec', 'request_id': 'req-a70daf61-882d-43b9-9d2b-0d01652abe79'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.808727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea8677c9c27420eb5556affc5526cec', 'request_id': 'req-a70daf61-882d-43b9-9d2b-0d01652abe79'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.815737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea8677c9c27420eb5556affc5526cec', 'request_id': 'req-a70daf61-882d-43b9-9d2b-0d01652abe79'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.830874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] The token cache is being invalidate because project 4ea8677c9c27420eb5556affc5526cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:31.831156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.831782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a70daf61-882d-43b9-9d2b-0d01652abe79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:31.833353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 955/1922] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:31 2022] DELETE /identity/v3/projects/4ea8677c9c27420eb5556affc5526cec => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:31.838466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb27ed7-0d47-4399-b5ab-b25de574d612 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:31.838933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb27ed7-0d47-4399-b5ab-b25de574d612 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:31.839020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb27ed7-0d47-4399-b5ab-b25de574d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:31.858998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2cb27ed7-0d47-4399-b5ab-b25de574d612 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:31.860491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2cb27ed7-0d47-4399-b5ab-b25de574d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:31.920496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 968/1923] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:31.928961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500dac9-2712-42a2-bab5-310b130e2204 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:31.929266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500dac9-2712-42a2-bab5-310b130e2204 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:31.929553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500dac9-2712-42a2-bab5-310b130e2204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:31.948137 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5500dac9-2712-42a2-bab5-310b130e2204 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:31.949325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5500dac9-2712-42a2-bab5-310b130e2204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:31.957337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 956/1924] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:31.961711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb27ed7-0d47-4399-b5ab-b25de574d612 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:31.971467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb27ed7-0d47-4399-b5ab-b25de574d612 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:31.976739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb7f8-70a6-4610-9a1c-23e2e3d662a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:31.977346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb7f8-70a6-4610-9a1c-23e2e3d662a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:31.977624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb7f8-70a6-4610-9a1c-23e2e3d662a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:31.977895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eb7f8-70a6-4610-9a1c-23e2e3d662a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:31.978647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb7f8-70a6-4610-9a1c-23e2e3d662a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:31.978949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb7f8-70a6-4610-9a1c-23e2e3d662a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:31.980589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eb7f8-70a6-4610-9a1c-23e2e3d662a9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:31.992896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 969/1925] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:31.997912 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500dac9-2712-42a2-bab5-310b130e2204 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.007539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500dac9-2712-42a2-bab5-310b130e2204 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.012450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6103e-ddc1-4942-a492-61ef4beb9e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.013184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6103e-ddc1-4942-a492-61ef4beb9e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.013474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6103e-ddc1-4942-a492-61ef4beb9e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.013758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6103e-ddc1-4942-a492-61ef4beb9e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.014470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6103e-ddc1-4942-a492-61ef4beb9e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.016453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6103e-ddc1-4942-a492-61ef4beb9e1b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.046675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 957/1926] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:31 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:32.052881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb7f8-70a6-4610-9a1c-23e2e3d662a9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.065876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eb7f8-70a6-4610-9a1c-23e2e3d662a9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.127826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cac23-7cc6-4bb3-ad8e-70750dae6bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.128547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cac23-7cc6-4bb3-ad8e-70750dae6bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.128829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cac23-7cc6-4bb3-ad8e-70750dae6bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.129165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cac23-7cc6-4bb3-ad8e-70750dae6bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.129936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cac23-7cc6-4bb3-ad8e-70750dae6bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.131860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cac23-7cc6-4bb3-ad8e-70750dae6bc3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.159310 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 970/1927] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:32 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:32.160170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6103e-ddc1-4942-a492-61ef4beb9e1b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.176532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6103e-ddc1-4942-a492-61ef4beb9e1b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.181170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e6c77-2218-44da-ac78-957fa82d7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.181845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e6c77-2218-44da-ac78-957fa82d7bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.182127 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e6c77-2218-44da-ac78-957fa82d7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.182403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e6c77-2218-44da-ac78-957fa82d7bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.183139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e6c77-2218-44da-ac78-957fa82d7bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.185044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e6c77-2218-44da-ac78-957fa82d7bc8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.197402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 958/1928] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:32.201529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cac23-7cc6-4bb3-ad8e-70750dae6bc3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.211608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cac23-7cc6-4bb3-ad8e-70750dae6bc3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.216359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50b14b-2792-4a08-befa-7344bf41aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.217035 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50b14b-2792-4a08-befa-7344bf41aa3e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.217320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50b14b-2792-4a08-befa-7344bf41aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.217599 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50b14b-2792-4a08-befa-7344bf41aa3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.218332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50b14b-2792-4a08-befa-7344bf41aa3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.219949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50b14b-2792-4a08-befa-7344bf41aa3e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.230552 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 971/1929] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:32.234658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e6c77-2218-44da-ac78-957fa82d7bc8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.245349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e6c77-2218-44da-ac78-957fa82d7bc8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.250489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d790e4-ad44-4be5-8cf1-59e5b548cecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.251562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d790e4-ad44-4be5-8cf1-59e5b548cecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.251966 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d790e4-ad44-4be5-8cf1-59e5b548cecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.252278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d790e4-ad44-4be5-8cf1-59e5b548cecb admin admin] PATH_INFO: `/v3/projects/9850660e60ff4e82ade250e78d5f2048/users/b9241e54927c4f72a14910a4b649c3f5/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.272557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d790e4-ad44-4be5-8cf1-59e5b548cecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9850660e60ff4e82ade250e78d5f2048, user_id=b9241e54927c4f72a14910a4b649c3f5, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.279221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d790e4-ad44-4be5-8cf1-59e5b548cecb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.296175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:32.307811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 959/1930] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:32 2022] PUT /identity/v3/projects/9850660e60ff4e82ade250e78d5f2048/users/b9241e54927c4f72a14910a4b649c3f5/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:32.318217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22f1b5-e9da-4cde-b1fe-3aab22b41dd0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.318515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22f1b5-e9da-4cde-b1fe-3aab22b41dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.318799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22f1b5-e9da-4cde-b1fe-3aab22b41dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.343439 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:32.352081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3e22f1b5-e9da-4cde-b1fe-3aab22b41dd0 None None] MFA Rules not processed for user `b9241e54927c4f72a14910a4b649c3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:32.353858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3e22f1b5-e9da-4cde-b1fe-3aab22b41dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:32.430693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 972/1931] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:32.435342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d790e4-ad44-4be5-8cf1-59e5b548cecb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.496733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d790e4-ad44-4be5-8cf1-59e5b548cecb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.501501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e7d2-a1e6-43d2-bf5d-7b9ae5c6a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.502173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e7d2-a1e6-43d2-bf5d-7b9ae5c6a4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.502457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e7d2-a1e6-43d2-bf5d-7b9ae5c6a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.502736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e7d2-a1e6-43d2-bf5d-7b9ae5c6a4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.503443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e7d2-a1e6-43d2-bf5d-7b9ae5c6a4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.505447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e7d2-a1e6-43d2-bf5d-7b9ae5c6a4c3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.532745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 960/1932] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:32 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:32.536924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22f1b5-e9da-4cde-b1fe-3aab22b41dd0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.548816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22f1b5-e9da-4cde-b1fe-3aab22b41dd0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.608495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e586b0d-1fbe-47ad-baf4-f6ea5ffb4298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.609210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e586b0d-1fbe-47ad-baf4-f6ea5ffb4298 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.609490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e586b0d-1fbe-47ad-baf4-f6ea5ffb4298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.609758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e586b0d-1fbe-47ad-baf4-f6ea5ffb4298 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.610453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e586b0d-1fbe-47ad-baf4-f6ea5ffb4298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.612409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e586b0d-1fbe-47ad-baf4-f6ea5ffb4298 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.636812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 973/1933] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:32 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:32.641337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e7d2-a1e6-43d2-bf5d-7b9ae5c6a4c3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.652931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e7d2-a1e6-43d2-bf5d-7b9ae5c6a4c3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.665682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e08a9-cea9-4dc3-b82f-29786183f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.665682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e08a9-cea9-4dc3-b82f-29786183f8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.665682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e08a9-cea9-4dc3-b82f-29786183f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.665682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e08a9-cea9-4dc3-b82f-29786183f8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.666096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e08a9-cea9-4dc3-b82f-29786183f8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.666096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e08a9-cea9-4dc3-b82f-29786183f8d2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.674434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 961/1934] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:32.678467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e586b0d-1fbe-47ad-baf4-f6ea5ffb4298 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.688662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e586b0d-1fbe-47ad-baf4-f6ea5ffb4298 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.693276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd15ea4-08fa-4422-8912-8af7b93db049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.694166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd15ea4-08fa-4422-8912-8af7b93db049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.694450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd15ea4-08fa-4422-8912-8af7b93db049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.694734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd15ea4-08fa-4422-8912-8af7b93db049 admin admin] PATH_INFO: `/v3/projects/5c23c0519cf5426588f8f98e57a88c86/users/00802c15e0524198aca6c33961292a37/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.709402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd15ea4-08fa-4422-8912-8af7b93db049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c23c0519cf5426588f8f98e57a88c86, user_id=00802c15e0524198aca6c33961292a37, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.712084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd15ea4-08fa-4422-8912-8af7b93db049 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.727080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 974/1935] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:32 2022] PUT /identity/v3/projects/5c23c0519cf5426588f8f98e57a88c86/users/00802c15e0524198aca6c33961292a37/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:32.731623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e08a9-cea9-4dc3-b82f-29786183f8d2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.745444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e08a9-cea9-4dc3-b82f-29786183f8d2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.810210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec504c5-3911-4f03-8fb8-90b384f64b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.810886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec504c5-3911-4f03-8fb8-90b384f64b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.811174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec504c5-3911-4f03-8fb8-90b384f64b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.811452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec504c5-3911-4f03-8fb8-90b384f64b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.812253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec504c5-3911-4f03-8fb8-90b384f64b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.813891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec504c5-3911-4f03-8fb8-90b384f64b2b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.825051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 962/1936] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:32.829861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd15ea4-08fa-4422-8912-8af7b93db049 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:32.841348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd15ea4-08fa-4422-8912-8af7b93db049 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:32.847244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd62a4a-4a28-4666-88f2-12e672a32a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:32.848181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd62a4a-4a28-4666-88f2-12e672a32a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.848484 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd62a4a-4a28-4666-88f2-12e672a32a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.848760 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd62a4a-4a28-4666-88f2-12e672a32a8c admin admin] PATH_INFO: `/v3/projects/5c23c0519cf5426588f8f98e57a88c86/users/00802c15e0524198aca6c33961292a37/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.851032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd62a4a-4a28-4666-88f2-12e672a32a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c23c0519cf5426588f8f98e57a88c86, user_id=00802c15e0524198aca6c33961292a37, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:32.853747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd62a4a-4a28-4666-88f2-12e672a32a8c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:32.868084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 975/1937] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:32 2022] PUT /identity/v3/projects/5c23c0519cf5426588f8f98e57a88c86/users/00802c15e0524198aca6c33961292a37/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:32.879859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5beff-cc60-454b-ad7a-1d406c291987 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:32.880232 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5beff-cc60-454b-ad7a-1d406c291987 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:32.880511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5beff-cc60-454b-ad7a-1d406c291987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:32.908386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0ad5beff-cc60-454b-ad7a-1d406c291987 None None] MFA Rules not processed for user `00802c15e0524198aca6c33961292a37`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:32.909519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0ad5beff-cc60-454b-ad7a-1d406c291987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:32.981278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:32.993569 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 963/1938] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:32 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:33.005295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd62a4a-4a28-4666-88f2-12e672a32a8c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:33.007091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3fd62a4a-4a28-4666-88f2-12e672a32a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:33.079095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd62a4a-4a28-4666-88f2-12e672a32a8c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:33.082864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c669-8d5b-4420-82f8-a5be8a524c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:33.083510 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c669-8d5b-4420-82f8-a5be8a524c8d service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:33.083796 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c669-8d5b-4420-82f8-a5be8a524c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:33.084111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c669-8d5b-4420-82f8-a5be8a524c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:33.091564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:33.094413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1c669-8d5b-4420-82f8-a5be8a524c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:33.095895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1c669-8d5b-4420-82f8-a5be8a524c8d service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:33.107120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 976/1939] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:33.189950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5beff-cc60-454b-ad7a-1d406c291987 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:33.191508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0ad5beff-cc60-454b-ad7a-1d406c291987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:33.204872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5beff-cc60-454b-ad7a-1d406c291987 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:33.208666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d7438-8fee-4e00-a445-b1d9d7ea1d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:33.209321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d7438-8fee-4e00-a445-b1d9d7ea1d0e service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:33.209603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d7438-8fee-4e00-a445-b1d9d7ea1d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:33.209922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d7438-8fee-4e00-a445-b1d9d7ea1d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:33.267461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d7438-8fee-4e00-a445-b1d9d7ea1d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:33.268978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d7438-8fee-4e00-a445-b1d9d7ea1d0e service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:33.277753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 964/1940] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:43.104026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:43.273766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=31 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:45.046168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c669-8d5b-4420-82f8-a5be8a524c8d service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:45.047737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2ce1c669-8d5b-4420-82f8-a5be8a524c8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:45.140184 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c669-8d5b-4420-82f8-a5be8a524c8d service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:45.147007 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:45.148054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:45.148345 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:45.148625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] PATH_INFO: `/v3/users/e204972a11e14a16bc70e8d348514581` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:45.150338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e204972a11e14a16bc70e8d348514581)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:45.152571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:45.215027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e204972a11e14a16bc70e8d348514581'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:45.216281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e204972a11e14a16bc70e8d348514581'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:45.232829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e204972a11e14a16bc70e8d348514581'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:45.235421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e204972a11e14a16bc70e8d348514581'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:45.244943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e204972a11e14a16bc70e8d348514581'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:45.270174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 977/1941] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:45 2022] DELETE /identity/v3/users/e204972a11e14a16bc70e8d348514581 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:45.271203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677833c6-ec71-4a3e-ad62-dd2464c5077c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:45.272438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677833c6-ec71-4a3e-ad62-dd2464c5077c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:45.272727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677833c6-ec71-4a3e-ad62-dd2464c5077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:45.309526 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-677833c6-ec71-4a3e-ad62-dd2464c5077c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:45.316330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-677833c6-ec71-4a3e-ad62-dd2464c5077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:45.455215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 965/1942] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:45.465297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:45.466847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:45.587195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fef6c-1874-4f78-aaa3-070fc529657f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:45.591671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ce7c2-00d3-4822-a277-ccf52d0f1278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:45.592776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce7c2-00d3-4822-a277-ccf52d0f1278 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:45.592776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce7c2-00d3-4822-a277-ccf52d0f1278 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:45.592776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce7c2-00d3-4822-a277-ccf52d0f1278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:45.609307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ce7c2-00d3-4822-a277-ccf52d0f1278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:45.610970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ce7c2-00d3-4822-a277-ccf52d0f1278 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:45.616188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677833c6-ec71-4a3e-ad62-dd2464c5077c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:45.617950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-677833c6-ec71-4a3e-ad62-dd2464c5077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:45.623140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 978/1943] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:45.632419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677833c6-ec71-4a3e-ad62-dd2464c5077c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:45.637363 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:45.638508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:45.638953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:45.639726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] PATH_INFO: `/v3/users/b9241e54927c4f72a14910a4b649c3f5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:45.641452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9241e54927c4f72a14910a4b649c3f5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:45.644975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:45.770774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9241e54927c4f72a14910a4b649c3f5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:45.801017 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9241e54927c4f72a14910a4b649c3f5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:45.818615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9241e54927c4f72a14910a4b649c3f5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:45.830459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9241e54927c4f72a14910a4b649c3f5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:45.831228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9241e54927c4f72a14910a4b649c3f5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:45.842027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 966/1944] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:45 2022] DELETE /identity/v3/users/b9241e54927c4f72a14910a4b649c3f5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:45.848573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31800360-4125-4fb5-9819-7aad0417ec89 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:45.848864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31800360-4125-4fb5-9819-7aad0417ec89 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:45.849299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31800360-4125-4fb5-9819-7aad0417ec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:45.871091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-31800360-4125-4fb5-9819-7aad0417ec89 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:45.872541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-31800360-4125-4fb5-9819-7aad0417ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:45.892636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:45.978473 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 979/1945] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:45.988970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:45.990531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:46.064456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f6c81-1d62-4fc0-8ba8-6389fb5ca086 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:46.068538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd1b9e-799d-4cd6-9ca1-6e9d95f5cc6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:46.069196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd1b9e-799d-4cd6-9ca1-6e9d95f5cc6d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:46.069474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd1b9e-799d-4cd6-9ca1-6e9d95f5cc6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:46.069741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd1b9e-799d-4cd6-9ca1-6e9d95f5cc6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:46.087106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd1b9e-799d-4cd6-9ca1-6e9d95f5cc6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:46.088737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd1b9e-799d-4cd6-9ca1-6e9d95f5cc6d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:46.100289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31800360-4125-4fb5-9819-7aad0417ec89 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:46.102348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-31800360-4125-4fb5-9819-7aad0417ec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:46.114302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 967/1946] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:46.116830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31800360-4125-4fb5-9819-7aad0417ec89 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:46.122232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:46.123395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:46.123789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:46.124177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] PATH_INFO: `/v3/projects/53ecf3b022e04ad8a43f3316c03a469b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:46.125860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ecf3b022e04ad8a43f3316c03a469b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:46.128870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:46.195300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ecf3b022e04ad8a43f3316c03a469b', 'request_id': 'req-62d735b0-026c-4960-b38b-fb532036df5d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.208918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ecf3b022e04ad8a43f3316c03a469b', 'request_id': 'req-62d735b0-026c-4960-b38b-fb532036df5d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.225563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ecf3b022e04ad8a43f3316c03a469b', 'request_id': 'req-62d735b0-026c-4960-b38b-fb532036df5d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.247370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] The token cache is being invalidate because project 53ecf3b022e04ad8a43f3316c03a469b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:46.247999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.249700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.257323 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 980/1947] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:46 2022] DELETE /identity/v3/projects/53ecf3b022e04ad8a43f3316c03a469b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:46.259009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd1b9e-799d-4cd6-9ca1-6e9d95f5cc6d service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:46.272207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd1b9e-799d-4cd6-9ca1-6e9d95f5cc6d service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:46.290459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:46.319656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:46.322200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:46.376848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:46.378127 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:46.378246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:46.378672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] PATH_INFO: `/v3/users/18b2caa98275467faccae825a095e632` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:46.381113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b2caa98275467faccae825a095e632)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:46.383610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:46.434706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d735b0-026c-4960-b38b-fb532036df5d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:46.442079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:46.443222 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:46.443586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:46.443979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] PATH_INFO: `/v3/users/7804a234e21b4bee8605c11f3e2794b6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:46.445409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7804a234e21b4bee8605c11f3e2794b6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:46.447738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:46.473205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b2caa98275467faccae825a095e632'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.497256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b2caa98275467faccae825a095e632'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.509574 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b2caa98275467faccae825a095e632'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.523959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b2caa98275467faccae825a095e632'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.524770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b2caa98275467faccae825a095e632'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.535126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 968/1948] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:46 2022] DELETE /identity/v3/users/18b2caa98275467faccae825a095e632 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:46.535126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:46.536120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:46.542506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7804a234e21b4bee8605c11f3e2794b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.543275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7804a234e21b4bee8605c11f3e2794b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.544705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:46.565919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7804a234e21b4bee8605c11f3e2794b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.566845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7804a234e21b4bee8605c11f3e2794b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.580681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4a9abfec-3be8-4a28-bcea-c52d6737186a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7804a234e21b4bee8605c11f3e2794b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.609926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 981/1949] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:46 2022] DELETE /identity/v3/users/7804a234e21b4bee8605c11f3e2794b6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:46.612490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35b657-7f20-47ca-a718-f49602d52b67 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:46.612972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35b657-7f20-47ca-a718-f49602d52b67 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:46.613456 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35b657-7f20-47ca-a718-f49602d52b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:46.634899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07a5fd-a57f-4d19-829b-81a9bce83e20 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:46.636939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9f35b657-7f20-47ca-a718-f49602d52b67 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:46.638168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9f35b657-7f20-47ca-a718-f49602d52b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:46.691918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:46.732444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:46.737759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:46.739249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:46.739579 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] PATH_INFO: `/v3/projects/9850660e60ff4e82ade250e78d5f2048` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:46.743615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9850660e60ff4e82ade250e78d5f2048)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:46.748991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:46.768709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 982/1950] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:46.793943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35b657-7f20-47ca-a718-f49602d52b67 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:46.798856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9f35b657-7f20-47ca-a718-f49602d52b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:46.858512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9850660e60ff4e82ade250e78d5f2048', 'request_id': 'req-7495c0c3-7c27-4eda-9277-11822b13bf2c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.880102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9850660e60ff4e82ade250e78d5f2048', 'request_id': 'req-7495c0c3-7c27-4eda-9277-11822b13bf2c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.889061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9850660e60ff4e82ade250e78d5f2048', 'request_id': 'req-7495c0c3-7c27-4eda-9277-11822b13bf2c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.902334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35b657-7f20-47ca-a718-f49602d52b67 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:46.910584 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] The token cache is being invalidate because project 9850660e60ff4e82ade250e78d5f2048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:46.911188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.912124 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:46.914018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 969/1951] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:46 2022] DELETE /identity/v3/projects/9850660e60ff4e82ade250e78d5f2048 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:46.921154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:46.924883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.007529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5a65a-0d8d-4d2f-b0c9-41ce7fce62da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:47.008311 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5a65a-0d8d-4d2f-b0c9-41ce7fce62da service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.008694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5a65a-0d8d-4d2f-b0c9-41ce7fce62da service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.008875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5a65a-0d8d-4d2f-b0c9-41ce7fce62da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.010753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-63f5a65a-0d8d-4d2f-b0c9-41ce7fce62da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.040195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495c0c3-7c27-4eda-9277-11822b13bf2c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:47.046243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:47.047147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.047428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.047695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] PATH_INFO: `/v3/users/00802c15e0524198aca6c33961292a37` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.049047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00802c15e0524198aca6c33961292a37)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:47.052037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:47.084788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:47.118756 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00802c15e0524198aca6c33961292a37'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.134828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00802c15e0524198aca6c33961292a37'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.136682 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5a65a-0d8d-4d2f-b0c9-41ce7fce62da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:47.138270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5a65a-0d8d-4d2f-b0c9-41ce7fce62da service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:47.152229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 983/1952] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:47.152229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5a65a-0d8d-4d2f-b0c9-41ce7fce62da service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:47.152384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00802c15e0524198aca6c33961292a37'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.153399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-63f5a65a-0d8d-4d2f-b0c9-41ce7fce62da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.155511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:47.168056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00802c15e0524198aca6c33961292a37'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.168825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5a65a-0d8d-4d2f-b0c9-41ce7fce62da service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:47.168953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00802c15e0524198aca6c33961292a37'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.174360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:47.175346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.175542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.175877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] PATH_INFO: `/v3/projects/10ae281aa5884500a693479e1a912445` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.177028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ae281aa5884500a693479e1a912445)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:47.177800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 970/1953] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:46 2022] DELETE /identity/v3/users/00802c15e0524198aca6c33961292a37 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:47.178963 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:47.182000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:47.183542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.249907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ae281aa5884500a693479e1a912445', 'request_id': 'req-9110a577-8a75-4101-b2e1-ef17fe8dd93e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.268611 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ae281aa5884500a693479e1a912445', 'request_id': 'req-9110a577-8a75-4101-b2e1-ef17fe8dd93e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.279099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ae281aa5884500a693479e1a912445', 'request_id': 'req-9110a577-8a75-4101-b2e1-ef17fe8dd93e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.301362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f49d-e65b-4bf8-9298-544ce3191a7f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:47.305637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] The token cache is being invalidate because project 10ae281aa5884500a693479e1a912445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:47.306202 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.308211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9110a577-8a75-4101-b2e1-ef17fe8dd93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.312638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 984/1954] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:47 2022] DELETE /identity/v3/projects/10ae281aa5884500a693479e1a912445 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:47.317604 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958582d8-bab7-4aa7-9e75-128468a4fe41 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.318110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958582d8-bab7-4aa7-9e75-128468a4fe41 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.318537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958582d8-bab7-4aa7-9e75-128468a4fe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.345300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-958582d8-bab7-4aa7-9e75-128468a4fe41 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:47.346792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-958582d8-bab7-4aa7-9e75-128468a4fe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.413496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:47.420057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.424146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.424530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] PATH_INFO: `/v3/users/382e7f0bbaf74ed68812c061565f8713` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.426552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] RBAC: Authorizing `identity:delete_user(user_id=382e7f0bbaf74ed68812c061565f8713)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:47.428942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:47.492016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 985/1955] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:47.495602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990244dc-f6df-4d1e-97fa-f5217ee65eb6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.497152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382e7f0bbaf74ed68812c061565f8713'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.497326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990244dc-f6df-4d1e-97fa-f5217ee65eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.497697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990244dc-f6df-4d1e-97fa-f5217ee65eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.513251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382e7f0bbaf74ed68812c061565f8713'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.527651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382e7f0bbaf74ed68812c061565f8713'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.540987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382e7f0bbaf74ed68812c061565f8713'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.541744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b1ec93d4-2023-4d91-927d-7dc02952052d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382e7f0bbaf74ed68812c061565f8713'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.545404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-990244dc-f6df-4d1e-97fa-f5217ee65eb6 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:47.548267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-990244dc-f6df-4d1e-97fa-f5217ee65eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.551669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 971/1956] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:47 2022] DELETE /identity/v3/users/382e7f0bbaf74ed68812c061565f8713 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:47.556959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35f12-2a79-4de5-b8ee-66991cd9950b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.557334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35f12-2a79-4de5-b8ee-66991cd9950b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.557687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35f12-2a79-4de5-b8ee-66991cd9950b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.583607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c9c35f12-2a79-4de5-b8ee-66991cd9950b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:47.585452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c9c35f12-2a79-4de5-b8ee-66991cd9950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.613907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:47.651905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:47.668819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 986/1957] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:47.672211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990244dc-f6df-4d1e-97fa-f5217ee65eb6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:47.672211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-990244dc-f6df-4d1e-97fa-f5217ee65eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.682063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 972/1958] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:47.684189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c35f12-2a79-4de5-b8ee-66991cd9950b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:47.684285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990244dc-f6df-4d1e-97fa-f5217ee65eb6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:47.684380 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c9c35f12-2a79-4de5-b8ee-66991cd9950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.690296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:47.691447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.691731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.692041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] PATH_INFO: `/v3/projects/9491fa0534294c778bbfd2209090ad3c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.693254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9491fa0534294c778bbfd2209090ad3c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:47.695174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:47.696300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c35f12-2a79-4de5-b8ee-66991cd9950b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:47.700944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:47.701855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.702147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.702426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] PATH_INFO: `/v3/projects/5c23c0519cf5426588f8f98e57a88c86` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.703624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c23c0519cf5426588f8f98e57a88c86)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:47.705576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:47.745213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9491fa0534294c778bbfd2209090ad3c', 'request_id': 'req-5052ab2e-f703-4503-bfc3-c08659a298af'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.752897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c23c0519cf5426588f8f98e57a88c86', 'request_id': 'req-725692eb-d546-490a-9efe-fee8a30d1283'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.754509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9491fa0534294c778bbfd2209090ad3c', 'request_id': 'req-5052ab2e-f703-4503-bfc3-c08659a298af'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.759562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c23c0519cf5426588f8f98e57a88c86', 'request_id': 'req-725692eb-d546-490a-9efe-fee8a30d1283'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.761144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9491fa0534294c778bbfd2209090ad3c', 'request_id': 'req-5052ab2e-f703-4503-bfc3-c08659a298af'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.766875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c23c0519cf5426588f8f98e57a88c86', 'request_id': 'req-725692eb-d546-490a-9efe-fee8a30d1283'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.772112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] The token cache is being invalidate because project 9491fa0534294c778bbfd2209090ad3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:47.772478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.773163 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.775087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 987/1959] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:47 2022] DELETE /identity/v3/projects/9491fa0534294c778bbfd2209090ad3c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:47.775654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:47.777073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.781635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] The token cache is being invalidate because project 5c23c0519cf5426588f8f98e57a88c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:47.781931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.782596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:47.784220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 973/1960] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:47 2022] DELETE /identity/v3/projects/5c23c0519cf5426588f8f98e57a88c86 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:47.785041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:47.786316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.846281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052ab2e-f703-4503-bfc3-c08659a298af admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:47.847003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725692eb-d546-490a-9efe-fee8a30d1283 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:47.850817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb798f-1b27-4e3b-a2d1-abcf55fc74ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:47.852058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb798f-1b27-4e3b-a2d1-abcf55fc74ee service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.852351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb798f-1b27-4e3b-a2d1-abcf55fc74ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.852632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb798f-1b27-4e3b-a2d1-abcf55fc74ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.854531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-30cb798f-1b27-4e3b-a2d1-abcf55fc74ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.919419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:47.920052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a568d-8c5d-4c8a-a7de-dabbbf2ed471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:47.921237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a568d-8c5d-4c8a-a7de-dabbbf2ed471 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.921672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a568d-8c5d-4c8a-a7de-dabbbf2ed471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.922090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a568d-8c5d-4c8a-a7de-dabbbf2ed471 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.922855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a568d-8c5d-4c8a-a7de-dabbbf2ed471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:47.923167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a568d-8c5d-4c8a-a7de-dabbbf2ed471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:47.924848 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a568d-8c5d-4c8a-a7de-dabbbf2ed471 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:47.941068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 988/1961] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:47.941068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a568d-8c5d-4c8a-a7de-dabbbf2ed471 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:47.942378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-109a568d-8c5d-4c8a-a7de-dabbbf2ed471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.945852 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb798f-1b27-4e3b-a2d1-abcf55fc74ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:47.947931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb798f-1b27-4e3b-a2d1-abcf55fc74ee service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:47.956624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a568d-8c5d-4c8a-a7de-dabbbf2ed471 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:47.959085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 974/1962] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:47.960338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24318a68-e454-4617-b35e-06924a6c253a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.960629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24318a68-e454-4617-b35e-06924a6c253a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.960912 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24318a68-e454-4617-b35e-06924a6c253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.961868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:47.962968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:47.963336 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:47.963763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] PATH_INFO: `/v3/users/50ac2f1b434143db9815d6c535eedc78` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:47.964993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ac2f1b434143db9815d6c535eedc78)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:47.967319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:47.979607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-24318a68-e454-4617-b35e-06924a6c253a None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:47.981458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-24318a68-e454-4617-b35e-06924a6c253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:47.982437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:48.001987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 975/1963] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:48.003308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24318a68-e454-4617-b35e-06924a6c253a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.005258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-24318a68-e454-4617-b35e-06924a6c253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:48.021908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24318a68-e454-4617-b35e-06924a6c253a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.028529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdef0da-eb23-4e71-b903-b559587f5796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.029316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef0da-eb23-4e71-b903-b559587f5796 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.029605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef0da-eb23-4e71-b903-b559587f5796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.029905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef0da-eb23-4e71-b903-b559587f5796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.030699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdef0da-eb23-4e71-b903-b559587f5796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.033534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdef0da-eb23-4e71-b903-b559587f5796 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.038456 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ac2f1b434143db9815d6c535eedc78'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:48.039148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ac2f1b434143db9815d6c535eedc78'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:48.056742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ac2f1b434143db9815d6c535eedc78'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:48.057634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ac2f1b434143db9815d6c535eedc78'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:48.065034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 976/1964] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:48 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:48.067100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ac2f1b434143db9815d6c535eedc78'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:48.069708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701d9a-f381-4823-926d-8b6eea1664a9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.070143 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701d9a-f381-4823-926d-8b6eea1664a9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.070349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701d9a-f381-4823-926d-8b6eea1664a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.084834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 989/1965] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:47 2022] DELETE /identity/v3/users/50ac2f1b434143db9815d6c535eedc78 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:48.087804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.087804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:48.091432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-48701d9a-f381-4823-926d-8b6eea1664a9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:48.093144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-48701d9a-f381-4823-926d-8b6eea1664a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:48.200051 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c84ff-f408-46fa-aeb6-cb038862d4c2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.206076 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c111-904a-4d6d-b0ff-7f982940d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.206767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c111-904a-4d6d-b0ff-7f982940d8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.207048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c111-904a-4d6d-b0ff-7f982940d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.207321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c111-904a-4d6d-b0ff-7f982940d8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.208108 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8c111-904a-4d6d-b0ff-7f982940d8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.210504 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8c111-904a-4d6d-b0ff-7f982940d8c4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.241318 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 990/1966] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:48 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:48.244872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c111-904a-4d6d-b0ff-7f982940d8c4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.248129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 977/1967] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:48.252547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701d9a-f381-4823-926d-8b6eea1664a9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.259543 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c111-904a-4d6d-b0ff-7f982940d8c4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.265765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48701d9a-f381-4823-926d-8b6eea1664a9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.267682 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47174cf1-f703-4a80-9c10-9aebaaefa426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.269730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47174cf1-f703-4a80-9c10-9aebaaefa426 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.270236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47174cf1-f703-4a80-9c10-9aebaaefa426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.270585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47174cf1-f703-4a80-9c10-9aebaaefa426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.272215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47174cf1-f703-4a80-9c10-9aebaaefa426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.274224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47174cf1-f703-4a80-9c10-9aebaaefa426 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.274516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0aad5-fe8c-402b-84a0-064f6fd47eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.276042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0aad5-fe8c-402b-84a0-064f6fd47eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.276513 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0aad5-fe8c-402b-84a0-064f6fd47eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.277029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0aad5-fe8c-402b-84a0-064f6fd47eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.278007 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0aad5-fe8c-402b-84a0-064f6fd47eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:48.279186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0aad5-fe8c-402b-84a0-064f6fd47eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.281772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0aad5-fe8c-402b-84a0-064f6fd47eaa admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.301831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 978/1968] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:48.306896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0aad5-fe8c-402b-84a0-064f6fd47eaa admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.314207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 991/1969] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:48.317403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47174cf1-f703-4a80-9c10-9aebaaefa426 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.319466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0aad5-fe8c-402b-84a0-064f6fd47eaa admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.324302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dde3d-7046-4523-bd4f-f3bac9622375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.325636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dde3d-7046-4523-bd4f-f3bac9622375 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.325636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dde3d-7046-4523-bd4f-f3bac9622375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.325636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dde3d-7046-4523-bd4f-f3bac9622375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.326194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dde3d-7046-4523-bd4f-f3bac9622375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.328835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dde3d-7046-4523-bd4f-f3bac9622375 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.344263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47174cf1-f703-4a80-9c10-9aebaaefa426 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.355854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a881ed5-cd08-4c28-9aa1-cbdeaf98d7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.357186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881ed5-cd08-4c28-9aa1-cbdeaf98d7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.359220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881ed5-cd08-4c28-9aa1-cbdeaf98d7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.359656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881ed5-cd08-4c28-9aa1-cbdeaf98d7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.360901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a881ed5-cd08-4c28-9aa1-cbdeaf98d7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.365475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a881ed5-cd08-4c28-9aa1-cbdeaf98d7fc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.373388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 979/1970] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:48 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:48.378274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dde3d-7046-4523-bd4f-f3bac9622375 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.388847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 992/1971] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:48.390090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a881ed5-cd08-4c28-9aa1-cbdeaf98d7fc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.404480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a881ed5-cd08-4c28-9aa1-cbdeaf98d7fc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.487814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dde3d-7046-4523-bd4f-f3bac9622375 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.493463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee71383-8f5d-4322-bebd-1a1574cfe254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.494387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71383-8f5d-4322-bebd-1a1574cfe254 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.494682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71383-8f5d-4322-bebd-1a1574cfe254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.495005 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71383-8f5d-4322-bebd-1a1574cfe254 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.495752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee71383-8f5d-4322-bebd-1a1574cfe254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.497226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f379d-8e66-4f91-b92f-4520a4863d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.498017 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee71383-8f5d-4322-bebd-1a1574cfe254 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.498779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f379d-8e66-4f91-b92f-4520a4863d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.499300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f379d-8e66-4f91-b92f-4520a4863d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.499638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f379d-8e66-4f91-b92f-4520a4863d14 admin admin] PATH_INFO: `/v3/projects/26df21233a23488f83456b30080d7e7b/users/c2b148e26cb94afab1723583442ca53a/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.502612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:48.535576 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f379d-8e66-4f91-b92f-4520a4863d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26df21233a23488f83456b30080d7e7b, user_id=c2b148e26cb94afab1723583442ca53a, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.538730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f379d-8e66-4f91-b92f-4520a4863d14 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.563377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 993/1972] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:48 2022] PUT /identity/v3/projects/26df21233a23488f83456b30080d7e7b/users/c2b148e26cb94afab1723583442ca53a/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:48.575120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f379d-8e66-4f91-b92f-4520a4863d14 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.577062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a01f379d-8e66-4f91-b92f-4520a4863d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:48.583485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 980/1973] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:48 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:48.586812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a301b-f860-410d-8d71-0f31695c21e6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.587107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a301b-f860-410d-8d71-0f31695c21e6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.587385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a301b-f860-410d-8d71-0f31695c21e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.641989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-368a301b-f860-410d-8d71-0f31695c21e6 None None] MFA Rules not processed for user `c2b148e26cb94afab1723583442ca53a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:48.643667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-368a301b-f860-410d-8d71-0f31695c21e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:48.650603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:48.722697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f379d-8e66-4f91-b92f-4520a4863d14 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.730295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.731185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.731463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.731735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] PATH_INFO: `/v3/projects/a1ba3648467e48c89316ad8fb7ea0845` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.733060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ba3648467e48c89316ad8fb7ea0845)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.735189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.773727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 981/1974] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:48.774768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a301b-f860-410d-8d71-0f31695c21e6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.797976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a301b-f860-410d-8d71-0f31695c21e6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.811893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ba3648467e48c89316ad8fb7ea0845', 'request_id': 'req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:48.829761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ba3648467e48c89316ad8fb7ea0845', 'request_id': 'req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:48.838611 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ba3648467e48c89316ad8fb7ea0845', 'request_id': 'req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:48.863490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] The token cache is being invalidate because project a1ba3648467e48c89316ad8fb7ea0845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:48.864185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:48.871457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:48.874786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e06d7a-8b9c-4c9c-b7da-393dafd2753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.875674 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e06d7a-8b9c-4c9c-b7da-393dafd2753c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.875960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e06d7a-8b9c-4c9c-b7da-393dafd2753c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.876423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e06d7a-8b9c-4c9c-b7da-393dafd2753c admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.877356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e06d7a-8b9c-4c9c-b7da-393dafd2753c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.879235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e06d7a-8b9c-4c9c-b7da-393dafd2753c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.882602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 994/1975] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:48 2022] DELETE /identity/v3/projects/a1ba3648467e48c89316ad8fb7ea0845 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:48.886754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.891590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:48.896456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 982/1976] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:48.896456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e06d7a-8b9c-4c9c-b7da-393dafd2753c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:48.898271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d4e06d7a-8b9c-4c9c-b7da-393dafd2753c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:48.919096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e06d7a-8b9c-4c9c-b7da-393dafd2753c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.919244 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8746b6-e555-4ad4-ae39-4ff94bd5057e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:48.919549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61070e90-e054-40c9-8f68-cc21284ba3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.920428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070e90-e054-40c9-8f68-cc21284ba3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.920684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070e90-e054-40c9-8f68-cc21284ba3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.920963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070e90-e054-40c9-8f68-cc21284ba3c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.921859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61070e90-e054-40c9-8f68-cc21284ba3c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.924106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61070e90-e054-40c9-8f68-cc21284ba3c5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.928274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:48.929295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.929648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.929996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] PATH_INFO: `/v3/projects/e516a5843f8f48488a277aafcffde753` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.931290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e516a5843f8f48488a277aafcffde753)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:48.933662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:48.969899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 983/1977] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:48 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:48.972083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e8780-5306-4e63-8e8f-f2113c09c85a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:48.972785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e8780-5306-4e63-8e8f-f2113c09c85a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:48.973276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e8780-5306-4e63-8e8f-f2113c09c85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:48.991418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e516a5843f8f48488a277aafcffde753', 'request_id': 'req-c19e5e1d-7767-4786-b61f-39086a467e7c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:49.002114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e516a5843f8f48488a277aafcffde753', 'request_id': 'req-c19e5e1d-7767-4786-b61f-39086a467e7c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:49.002597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5a2e8780-5306-4e63-8e8f-f2113c09c85a None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:49.003801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5a2e8780-5306-4e63-8e8f-f2113c09c85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:49.009214 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e516a5843f8f48488a277aafcffde753', 'request_id': 'req-c19e5e1d-7767-4786-b61f-39086a467e7c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:49.014833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:49.023193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] The token cache is being invalidate because project e516a5843f8f48488a277aafcffde753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:49.023849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:49.024723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:49.027007 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 995/1978] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:48 2022] DELETE /identity/v3/projects/e516a5843f8f48488a277aafcffde753 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:49.032483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.036152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:49.081989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 984/1979] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:49.081989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e8780-5306-4e63-8e8f-f2113c09c85a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.083523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5a2e8780-5306-4e63-8e8f-f2113c09c85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:49.099777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e8780-5306-4e63-8e8f-f2113c09c85a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.116932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae1751-41ca-4f22-99e9-e4810a273b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.118530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae1751-41ca-4f22-99e9-e4810a273b26 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.118988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae1751-41ca-4f22-99e9-e4810a273b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.119807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae1751-41ca-4f22-99e9-e4810a273b26 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.122011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae1751-41ca-4f22-99e9-e4810a273b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.126649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae1751-41ca-4f22-99e9-e4810a273b26 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.132467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e5e1d-7767-4786-b61f-39086a467e7c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.140529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132ba41-9f76-4a5a-8397-8fc774da5ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.141469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132ba41-9f76-4a5a-8397-8fc774da5ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.141803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132ba41-9f76-4a5a-8397-8fc774da5ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.142150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132ba41-9f76-4a5a-8397-8fc774da5ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.143081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132ba41-9f76-4a5a-8397-8fc774da5ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.145014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132ba41-9f76-4a5a-8397-8fc774da5ba2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.161575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 996/1980] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:49.163024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c9e7d-b823-4870-a721-92374b3db42d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.163330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c9e7d-b823-4870-a721-92374b3db42d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.163606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c9e7d-b823-4870-a721-92374b3db42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.169432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 985/1981] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:49.169432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee806e9-54a0-44e7-aa0b-581b7f636430 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.169432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee806e9-54a0-44e7-aa0b-581b7f636430 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.169432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee806e9-54a0-44e7-aa0b-581b7f636430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.180100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:49.184588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5c8c9e7d-b823-4870-a721-92374b3db42d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:49.185838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5c8c9e7d-b823-4870-a721-92374b3db42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:49.194349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 997/1982] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:49.195165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c9e7d-b823-4870-a721-92374b3db42d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.210657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c9e7d-b823-4870-a721-92374b3db42d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.216689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d9b75-292a-48bd-afdb-9a51be74d921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.217875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9b75-292a-48bd-afdb-9a51be74d921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.218337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9b75-292a-48bd-afdb-9a51be74d921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.218738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9b75-292a-48bd-afdb-9a51be74d921 admin admin] PATH_INFO: `/v3/projects/ced8ab69118a4ddb92d292db7d9f7cca/users/bc5c3686783749cfbeda90d69270c515/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.225412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6ee806e9-54a0-44e7-aa0b-581b7f636430 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:49.226967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6ee806e9-54a0-44e7-aa0b-581b7f636430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:49.241242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d9b75-292a-48bd-afdb-9a51be74d921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced8ab69118a4ddb92d292db7d9f7cca, user_id=bc5c3686783749cfbeda90d69270c515, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.242986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 986/1983] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:49.243690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee806e9-54a0-44e7-aa0b-581b7f636430 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.244476 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d9b75-292a-48bd-afdb-9a51be74d921 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.255129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee806e9-54a0-44e7-aa0b-581b7f636430 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.261138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 998/1984] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:49 2022] PUT /identity/v3/projects/ced8ab69118a4ddb92d292db7d9f7cca/users/bc5c3686783749cfbeda90d69270c515/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:49.262441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e46440-b2ea-4fc5-a9d9-e87b0b3b72ee None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.263016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e46440-b2ea-4fc5-a9d9-e87b0b3b72ee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.263301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e46440-b2ea-4fc5-a9d9-e87b0b3b72ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.284144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f5e46440-b2ea-4fc5-a9d9-e87b0b3b72ee None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:49.286012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5e46440-b2ea-4fc5-a9d9-e87b0b3b72ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:49.336114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ff6d9-c5f1-4efa-a229-807d4e387cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.336891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ff6d9-c5f1-4efa-a229-807d4e387cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.337173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ff6d9-c5f1-4efa-a229-807d4e387cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.337444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ff6d9-c5f1-4efa-a229-807d4e387cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.338190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ff6d9-c5f1-4efa-a229-807d4e387cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.339814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ff6d9-c5f1-4efa-a229-807d4e387cc0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.352765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 987/1985] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:49.353651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ff6d9-c5f1-4efa-a229-807d4e387cc0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.364090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ff6d9-c5f1-4efa-a229-807d4e387cc0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.374266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e21b3-2fe0-48fb-897a-dfc0416bf39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.374994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e21b3-2fe0-48fb-897a-dfc0416bf39c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.375281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e21b3-2fe0-48fb-897a-dfc0416bf39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.375557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e21b3-2fe0-48fb-897a-dfc0416bf39c admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.376468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e21b3-2fe0-48fb-897a-dfc0416bf39c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:49.377060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e21b3-2fe0-48fb-897a-dfc0416bf39c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.381055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e21b3-2fe0-48fb-897a-dfc0416bf39c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.382720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 999/1986] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:49.384150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d99892-8866-4b28-afb1-a689989888ba None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.384534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d99892-8866-4b28-afb1-a689989888ba None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.384899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d99892-8866-4b28-afb1-a689989888ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.406033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 988/1987] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:49.406033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e21b3-2fe0-48fb-897a-dfc0416bf39c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.416708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e21b3-2fe0-48fb-897a-dfc0416bf39c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.421758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae680401-f29f-48a7-bf50-a0ae281260e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.422450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680401-f29f-48a7-bf50-a0ae281260e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.422732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680401-f29f-48a7-bf50-a0ae281260e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.423010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680401-f29f-48a7-bf50-a0ae281260e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.423750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae680401-f29f-48a7-bf50-a0ae281260e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.425782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae680401-f29f-48a7-bf50-a0ae281260e0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.429418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a6d99892-8866-4b28-afb1-a689989888ba None None] MFA Rules not processed for user `bc5c3686783749cfbeda90d69270c515`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:49.430638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a6d99892-8866-4b28-afb1-a689989888ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:49.439438 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 989/1988] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:49.443335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae680401-f29f-48a7-bf50-a0ae281260e0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.455849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae680401-f29f-48a7-bf50-a0ae281260e0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.461527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe27b2b-2eb7-4b02-8617-66649e1ad591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.462393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27b2b-2eb7-4b02-8617-66649e1ad591 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.462472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27b2b-2eb7-4b02-8617-66649e1ad591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.462745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe27b2b-2eb7-4b02-8617-66649e1ad591 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.463510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe27b2b-2eb7-4b02-8617-66649e1ad591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:49.463814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe27b2b-2eb7-4b02-8617-66649e1ad591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.465955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe27b2b-2eb7-4b02-8617-66649e1ad591 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.486664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 990/1989] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:49.489133 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe27b2b-2eb7-4b02-8617-66649e1ad591 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.494506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:49.502063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe27b2b-2eb7-4b02-8617-66649e1ad591 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.508394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a25adf-2a0b-498a-bad5-fae33bbb245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.509253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a25adf-2a0b-498a-bad5-fae33bbb245c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.510008 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a25adf-2a0b-498a-bad5-fae33bbb245c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.510350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a25adf-2a0b-498a-bad5-fae33bbb245c admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.511118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a25adf-2a0b-498a-bad5-fae33bbb245c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.513648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a25adf-2a0b-498a-bad5-fae33bbb245c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.515539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1000/1990] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:49.516725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d99892-8866-4b28-afb1-a689989888ba None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.535287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d99892-8866-4b28-afb1-a689989888ba None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.540931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876a1e1-a30a-437e-af4b-9eb706859a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.541847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876a1e1-a30a-437e-af4b-9eb706859a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.542132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876a1e1-a30a-437e-af4b-9eb706859a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.542411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876a1e1-a30a-437e-af4b-9eb706859a99 admin admin] PATH_INFO: `/v3/projects/49978bced8fd4669b64ba93eb8d4e53e/users/d6535f2e0f1e4f8294b407d612b443f2/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.554457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 991/1991] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:49.555560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a25adf-2a0b-498a-bad5-fae33bbb245c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.558014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876a1e1-a30a-437e-af4b-9eb706859a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49978bced8fd4669b64ba93eb8d4e53e, user_id=d6535f2e0f1e4f8294b407d612b443f2, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.560755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876a1e1-a30a-437e-af4b-9eb706859a99 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.575502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1001/1992] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:49 2022] PUT /identity/v3/projects/49978bced8fd4669b64ba93eb8d4e53e/users/d6535f2e0f1e4f8294b407d612b443f2/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:49.576364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876a1e1-a30a-437e-af4b-9eb706859a99 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.577994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0876a1e1-a30a-437e-af4b-9eb706859a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:49.623147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a25adf-2a0b-498a-bad5-fae33bbb245c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.639409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876a1e1-a30a-437e-af4b-9eb706859a99 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.644972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f231d-71e5-4016-851e-7aacc60f526f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4adc107bf542b8bb0502c7fbf94431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.645676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f231d-71e5-4016-851e-7aacc60f526f service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.645962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f231d-71e5-4016-851e-7aacc60f526f service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.646242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f231d-71e5-4016-851e-7aacc60f526f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.666202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:49.687889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894a7d3-0850-433e-aac4-635bde57223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.688623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894a7d3-0850-433e-aac4-635bde57223b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.688882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894a7d3-0850-433e-aac4-635bde57223b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.689155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894a7d3-0850-433e-aac4-635bde57223b admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.689857 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894a7d3-0850-433e-aac4-635bde57223b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.691821 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894a7d3-0850-433e-aac4-635bde57223b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.718900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f231d-71e5-4016-851e-7aacc60f526f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.720492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f231d-71e5-4016-851e-7aacc60f526f service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.727494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 992/1993] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/projects => generated 361 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:49.727494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894a7d3-0850-433e-aac4-635bde57223b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.732052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1002/1994] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:49.733490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c4f68-1da8-4f36-b1eb-85cba792e716 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.733784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c4f68-1da8-4f36-b1eb-85cba792e716 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.734064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c4f68-1da8-4f36-b1eb-85cba792e716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.763167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dd8c4f68-1da8-4f36-b1eb-85cba792e716 None None] MFA Rules not processed for user `d6535f2e0f1e4f8294b407d612b443f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:49.781699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dd8c4f68-1da8-4f36-b1eb-85cba792e716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:49.813908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894a7d3-0850-433e-aac4-635bde57223b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.821580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f3b85-bc0c-473f-8788-ffbefe925f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.822275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f3b85-bc0c-473f-8788-ffbefe925f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.822558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f3b85-bc0c-473f-8788-ffbefe925f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.822833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f3b85-bc0c-473f-8788-ffbefe925f61 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.823540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f3b85-bc0c-473f-8788-ffbefe925f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.825738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f3b85-bc0c-473f-8788-ffbefe925f61 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.854575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 993/1995] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:49.855139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f3b85-bc0c-473f-8788-ffbefe925f61 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.867568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f3b85-bc0c-473f-8788-ffbefe925f61 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.873633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dc3a2-4548-4b96-8fa9-55824c51eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.874549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc3a2-4548-4b96-8fa9-55824c51eb59 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.874834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc3a2-4548-4b96-8fa9-55824c51eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.875113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc3a2-4548-4b96-8fa9-55824c51eb59 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.876467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dc3a2-4548-4b96-8fa9-55824c51eb59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.878612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dc3a2-4548-4b96-8fa9-55824c51eb59 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.897300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1003/1996] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:49.898033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c4f68-1da8-4f36-b1eb-85cba792e716 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.912595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c4f68-1da8-4f36-b1eb-85cba792e716 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.916368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 994/1997] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/users => generated 281 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:49.917337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dc3a2-4548-4b96-8fa9-55824c51eb59 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.920990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7428b40-bcf5-4d70-9d88-c6d4873a4932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.922002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7428b40-bcf5-4d70-9d88-c6d4873a4932 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.922450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7428b40-bcf5-4d70-9d88-c6d4873a4932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.922865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7428b40-bcf5-4d70-9d88-c6d4873a4932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.923893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7428b40-bcf5-4d70-9d88-c6d4873a4932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.925630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7428b40-bcf5-4d70-9d88-c6d4873a4932 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.931685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:49.932170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dc3a2-4548-4b96-8fa9-55824c51eb59 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.938852 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457cae6-695d-4616-b9f1-aefca9dbe184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.939682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457cae6-695d-4616-b9f1-aefca9dbe184 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.939975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457cae6-695d-4616-b9f1-aefca9dbe184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.940285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457cae6-695d-4616-b9f1-aefca9dbe184 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.943729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1004/1998] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:49.943863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457cae6-695d-4616-b9f1-aefca9dbe184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.943942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7428b40-bcf5-4d70-9d88-c6d4873a4932 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.944267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457cae6-695d-4616-b9f1-aefca9dbe184 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.963076 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7428b40-bcf5-4d70-9d88-c6d4873a4932 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:49.970837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac999fc1-6738-48bf-92bc-8be84aa566b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:49.971932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999fc1-6738-48bf-92bc-8be84aa566b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:49.972378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999fc1-6738-48bf-92bc-8be84aa566b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:49.972755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac999fc1-6738-48bf-92bc-8be84aa566b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:49.973547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac999fc1-6738-48bf-92bc-8be84aa566b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:49.976126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac999fc1-6738-48bf-92bc-8be84aa566b4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:49.976975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 995/1999] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:49.977915 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457cae6-695d-4616-b9f1-aefca9dbe184 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:49.996627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1005/2000] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:49.996627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac999fc1-6738-48bf-92bc-8be84aa566b4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.017002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac999fc1-6738-48bf-92bc-8be84aa566b4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.076627 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457cae6-695d-4616-b9f1-aefca9dbe184 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.082060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3a28f-bdae-4a8b-8c84-7c9a1827a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.082649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3a28f-bdae-4a8b-8c84-7c9a1827a7ee admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.082935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3a28f-bdae-4a8b-8c84-7c9a1827a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.083208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3a28f-bdae-4a8b-8c84-7c9a1827a7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.083945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3a28f-bdae-4a8b-8c84-7c9a1827a7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.085590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3a28f-bdae-4a8b-8c84-7c9a1827a7ee admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.096289 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 996/2001] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:50.096899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3a28f-bdae-4a8b-8c84-7c9a1827a7ee admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.098014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248f20-2079-40d5-8f17-835646c06234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.098875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248f20-2079-40d5-8f17-835646c06234 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.099439 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248f20-2079-40d5-8f17-835646c06234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.099861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248f20-2079-40d5-8f17-835646c06234 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.100727 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248f20-2079-40d5-8f17-835646c06234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.103957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248f20-2079-40d5-8f17-835646c06234 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.106613 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3a28f-bdae-4a8b-8c84-7c9a1827a7ee admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.114618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d06ec8-536f-45f5-ae75-1ff13e5fda64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.116308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d06ec8-536f-45f5-ae75-1ff13e5fda64 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.116684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d06ec8-536f-45f5-ae75-1ff13e5fda64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.117338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d06ec8-536f-45f5-ae75-1ff13e5fda64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.118099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d06ec8-536f-45f5-ae75-1ff13e5fda64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.119768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d06ec8-536f-45f5-ae75-1ff13e5fda64 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.133694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1006/2002] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:49 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:50.134592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 997/2003] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:50.135294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248f20-2079-40d5-8f17-835646c06234 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.137299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d06ec8-536f-45f5-ae75-1ff13e5fda64 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.147625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:50.149202 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248f20-2079-40d5-8f17-835646c06234 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.156429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d06ec8-536f-45f5-ae75-1ff13e5fda64 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.160759 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc06f8-5f33-4df4-8a48-202366407136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.162406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc06f8-5f33-4df4-8a48-202366407136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.163137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc06f8-5f33-4df4-8a48-202366407136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.163972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc06f8-5f33-4df4-8a48-202366407136 admin admin] PATH_INFO: `/v3/projects/7980a28645eb4e3497f980a7383cbb33/users/418619ee6c5b4cde8bbbaf5fd9ac01d4/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.168597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6159abb-bb70-4ae2-9124-7e87472d07d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.169435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6159abb-bb70-4ae2-9124-7e87472d07d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.170634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6159abb-bb70-4ae2-9124-7e87472d07d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.171163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6159abb-bb70-4ae2-9124-7e87472d07d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.172121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6159abb-bb70-4ae2-9124-7e87472d07d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.173791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6159abb-bb70-4ae2-9124-7e87472d07d5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.183838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc06f8-5f33-4df4-8a48-202366407136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7980a28645eb4e3497f980a7383cbb33, user_id=418619ee6c5b4cde8bbbaf5fd9ac01d4, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.188045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc06f8-5f33-4df4-8a48-202366407136 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.195362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 998/2004] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:29:50.196259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6159abb-bb70-4ae2-9124-7e87472d07d5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.206945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6159abb-bb70-4ae2-9124-7e87472d07d5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.208909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1007/2005] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:50 2022] PUT /identity/v3/projects/7980a28645eb4e3497f980a7383cbb33/users/418619ee6c5b4cde8bbbaf5fd9ac01d4/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:50.209847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc06f8-5f33-4df4-8a48-202366407136 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.276269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf5505-e22d-4ccb-94c5-7aad7354f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.276269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf5505-e22d-4ccb-94c5-7aad7354f64d admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.276446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf5505-e22d-4ccb-94c5-7aad7354f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.276813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf5505-e22d-4ccb-94c5-7aad7354f64d admin admin] PATH_INFO: `/v3/projects/91c883732a584bf4bde792b3beed321f/users/5c3c5df2ab8344ef9b7cb948d0a66c81/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.303119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc06f8-5f33-4df4-8a48-202366407136 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.308854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a75368-703b-4ced-ac25-11f00d6c4da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.309888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75368-703b-4ced-ac25-11f00d6c4da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.310232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75368-703b-4ced-ac25-11f00d6c4da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.310573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a75368-703b-4ced-ac25-11f00d6c4da5 admin admin] PATH_INFO: `/v3/projects/986e0c797f2c4a51842710ccb5f699b4/users/ad7f8cd4d51947d7a236b72d06b0e5a5/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.322330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf5505-e22d-4ccb-94c5-7aad7354f64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c883732a584bf4bde792b3beed321f, user_id=5c3c5df2ab8344ef9b7cb948d0a66c81, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.325501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf5505-e22d-4ccb-94c5-7aad7354f64d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.334987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a75368-703b-4ced-ac25-11f00d6c4da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986e0c797f2c4a51842710ccb5f699b4, user_id=ad7f8cd4d51947d7a236b72d06b0e5a5, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.338240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a75368-703b-4ced-ac25-11f00d6c4da5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.346921 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 999/2006] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:50 2022] PUT /identity/v3/projects/91c883732a584bf4bde792b3beed321f/users/5c3c5df2ab8344ef9b7cb948d0a66c81/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:50.348905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cae589-a8f6-4dfa-bc7d-9b299fa75a16 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.349233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cae589-a8f6-4dfa-bc7d-9b299fa75a16 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.349642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cae589-a8f6-4dfa-bc7d-9b299fa75a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.372538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1008/2007] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:50 2022] PUT /identity/v3/projects/986e0c797f2c4a51842710ccb5f699b4/users/ad7f8cd4d51947d7a236b72d06b0e5a5/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:50.372538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda414-5ea6-45bc-b059-66b540c15043 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.372538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda414-5ea6-45bc-b059-66b540c15043 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.372538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcda414-5ea6-45bc-b059-66b540c15043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.391046 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a6cae589-a8f6-4dfa-bc7d-9b299fa75a16 None None] MFA Rules not processed for user `418619ee6c5b4cde8bbbaf5fd9ac01d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:50.392399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a6cae589-a8f6-4dfa-bc7d-9b299fa75a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:50.404868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4dcda414-5ea6-45bc-b059-66b540c15043 None None] MFA Rules not processed for user `5c3c5df2ab8344ef9b7cb948d0a66c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:50.407121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4dcda414-5ea6-45bc-b059-66b540c15043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:50.440949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:50.486408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1000/2008] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:50.488732 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1009/2009] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:50.489161 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cae589-a8f6-4dfa-bc7d-9b299fa75a16 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.493135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcda414-5ea6-45bc-b059-66b540c15043 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.565340 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cae589-a8f6-4dfa-bc7d-9b299fa75a16 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.574779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13243dd-5aa1-4c9f-a92c-ad6f164d59f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.575490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13243dd-5aa1-4c9f-a92c-ad6f164d59f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.575798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13243dd-5aa1-4c9f-a92c-ad6f164d59f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.576134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13243dd-5aa1-4c9f-a92c-ad6f164d59f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.577067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13243dd-5aa1-4c9f-a92c-ad6f164d59f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.577802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcda414-5ea6-45bc-b059-66b540c15043 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.579719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13243dd-5aa1-4c9f-a92c-ad6f164d59f6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.582814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06e412-e465-4d5f-9d8c-a22466184a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.583470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06e412-e465-4d5f-9d8c-a22466184a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.583758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06e412-e465-4d5f-9d8c-a22466184a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.584059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06e412-e465-4d5f-9d8c-a22466184a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.584771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06e412-e465-4d5f-9d8c-a22466184a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.586700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06e412-e465-4d5f-9d8c-a22466184a4b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.588343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:50.612157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1001/2010] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:50.612157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13243dd-5aa1-4c9f-a92c-ad6f164d59f6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.628694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13243dd-5aa1-4c9f-a92c-ad6f164d59f6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.631975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1010/2011] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:50 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:50.636920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06e412-e465-4d5f-9d8c-a22466184a4b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.722538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c69d4-f3c1-42e4-b23a-e609d8fa0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.723268 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06e412-e465-4d5f-9d8c-a22466184a4b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.723926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c69d4-f3c1-42e4-b23a-e609d8fa0e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.724481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c69d4-f3c1-42e4-b23a-e609d8fa0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.724987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c69d4-f3c1-42e4-b23a-e609d8fa0e5e admin admin] PATH_INFO: `/v3/projects/986e0c797f2c4a51842710ccb5f699b4/users/ad7f8cd4d51947d7a236b72d06b0e5a5/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.727199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c69d4-f3c1-42e4-b23a-e609d8fa0e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=986e0c797f2c4a51842710ccb5f699b4, user_id=ad7f8cd4d51947d7a236b72d06b0e5a5, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.728685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d316c-7676-4be0-aa98-d5c9655e5c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.729443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d316c-7676-4be0-aa98-d5c9655e5c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.729795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d316c-7676-4be0-aa98-d5c9655e5c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.731645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c69d4-f3c1-42e4-b23a-e609d8fa0e5e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.736281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d316c-7676-4be0-aa98-d5c9655e5c46 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.738708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d316c-7676-4be0-aa98-d5c9655e5c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.742609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d316c-7676-4be0-aa98-d5c9655e5c46 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.743683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1002/2012] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:50 2022] PUT /identity/v3/projects/986e0c797f2c4a51842710ccb5f699b4/users/ad7f8cd4d51947d7a236b72d06b0e5a5/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:50.749430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c69d4-f3c1-42e4-b23a-e609d8fa0e5e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.751349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cf8c69d4-f3c1-42e4-b23a-e609d8fa0e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:50.776259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1011/2013] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:50 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:50.777538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae091-98e3-40e9-a3b0-561a9ca3b4d5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.777829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae091-98e3-40e9-a3b0-561a9ca3b4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.778103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae091-98e3-40e9-a3b0-561a9ca3b4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.805073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bf8ae091-98e3-40e9-a3b0-561a9ca3b4d5 None None] MFA Rules not processed for user `ad7f8cd4d51947d7a236b72d06b0e5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:50.806282 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bf8ae091-98e3-40e9-a3b0-561a9ca3b4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:50.824329 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c69d4-f3c1-42e4-b23a-e609d8fa0e5e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.837426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11f75-ffb9-4f3c-a810-580e32a7d0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.838109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11f75-ffb9-4f3c-a810-580e32a7d0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.838561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11f75-ffb9-4f3c-a810-580e32a7d0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.839033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11f75-ffb9-4f3c-a810-580e32a7d0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.840648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:50.918136 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1012/2014] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:50.925408 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ae091-98e3-40e9-a3b0-561a9ca3b4d5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.941173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec11f75-ffb9-4f3c-a810-580e32a7d0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:50.942924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec11f75-ffb9-4f3c-a810-580e32a7d0d3 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:50.954646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1003/2015] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:50.955141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11f75-ffb9-4f3c-a810-580e32a7d0d3 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:50.956583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7ec11f75-ffb9-4f3c-a810-580e32a7d0d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:50.981024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11f75-ffb9-4f3c-a810-580e32a7d0d3 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:50.988379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4051f2-e573-4061-8c6c-683ec0f834bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:50.989622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4051f2-e573-4061-8c6c-683ec0f834bf service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:50.990066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4051f2-e573-4061-8c6c-683ec0f834bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:50.991026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4051f2-e573-4061-8c6c-683ec0f834bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:50.993603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3a4051f2-e573-4061-8c6c-683ec0f834bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:51.010580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ae091-98e3-40e9-a3b0-561a9ca3b4d5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:51.022889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93282e40-f616-4935-9dee-cc679414c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:51.023630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93282e40-f616-4935-9dee-cc679414c640 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:51.023917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93282e40-f616-4935-9dee-cc679414c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:51.024240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93282e40-f616-4935-9dee-cc679414c640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:51.025020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93282e40-f616-4935-9dee-cc679414c640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:51.026730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93282e40-f616-4935-9dee-cc679414c640 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:51.044054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1013/2016] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:51.044054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93282e40-f616-4935-9dee-cc679414c640 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:51.053446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93282e40-f616-4935-9dee-cc679414c640 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:51.058254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:51.059139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:51.059427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:51.060018 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] PATH_INFO: `/v3/users/5c3c5df2ab8344ef9b7cb948d0a66c81` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:51.061388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3c5df2ab8344ef9b7cb948d0a66c81)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:51.063464 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:51.069520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:51.089957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4051f2-e573-4061-8c6c-683ec0f834bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:51.091394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4051f2-e573-4061-8c6c-683ec0f834bf service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:51.102341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1004/2017] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:51.103243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4051f2-e573-4061-8c6c-683ec0f834bf service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:51.114208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4051f2-e573-4061-8c6c-683ec0f834bf service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:51.119235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234d57-6f6c-402c-a79d-79c7e3e1965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:51.120318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234d57-6f6c-402c-a79d-79c7e3e1965e admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:51.120716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234d57-6f6c-402c-a79d-79c7e3e1965e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:51.121086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234d57-6f6c-402c-a79d-79c7e3e1965e admin admin] PATH_INFO: `/v3/projects/c52c59b5fceb4d259d7484cf7a030217/users/66cc6326557344d8a1d10c7631774151/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:51.136094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3c5df2ab8344ef9b7cb948d0a66c81'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:51.144603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3c5df2ab8344ef9b7cb948d0a66c81'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:51.148836 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3234d57-6f6c-402c-a79d-79c7e3e1965e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52c59b5fceb4d259d7484cf7a030217, user_id=66cc6326557344d8a1d10c7631774151, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:51.151755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3234d57-6f6c-402c-a79d-79c7e3e1965e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:51.163450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3c5df2ab8344ef9b7cb948d0a66c81'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:51.164381 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3c5df2ab8344ef9b7cb948d0a66c81'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:51.173706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1005/2018] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:51 2022] PUT /identity/v3/projects/c52c59b5fceb4d259d7484cf7a030217/users/66cc6326557344d8a1d10c7631774151/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:51.179982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234d57-6f6c-402c-a79d-79c7e3e1965e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:51.184771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a3234d57-6f6c-402c-a79d-79c7e3e1965e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:51.185890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f19b47a2-8999-461c-bfd0-9b1554ae374f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3c5df2ab8344ef9b7cb948d0a66c81'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:51.206200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1014/2019] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:29:51 2022] DELETE /identity/v3/users/5c3c5df2ab8344ef9b7cb948d0a66c81 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:51.211308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254386e-c60d-44b2-bf39-5e77218c31ea None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:51.211597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254386e-c60d-44b2-bf39-5e77218c31ea None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:51.211870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254386e-c60d-44b2-bf39-5e77218c31ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:51.231983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3254386e-c60d-44b2-bf39-5e77218c31ea None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:51.244129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3254386e-c60d-44b2-bf39-5e77218c31ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:51.275428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234d57-6f6c-402c-a79d-79c7e3e1965e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:51.279511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:51.329098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1015/2020] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:51.339315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254386e-c60d-44b2-bf39-5e77218c31ea None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:51.340988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3254386e-c60d-44b2-bf39-5e77218c31ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:51.367357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec351-2f72-4398-9ce4-3451c141baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:51.378058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec351-2f72-4398-9ce4-3451c141baa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:51.378058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec351-2f72-4398-9ce4-3451c141baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:51.378058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec351-2f72-4398-9ce4-3451c141baa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:51.378058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec351-2f72-4398-9ce4-3451c141baa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:51.378058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec351-2f72-4398-9ce4-3451c141baa9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:51.383855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1006/2021] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:51.387702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec351-2f72-4398-9ce4-3451c141baa9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:51.399266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec351-2f72-4398-9ce4-3451c141baa9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:51.404459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68762049-f003-4ff9-9407-a14758004af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:51.405526 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68762049-f003-4ff9-9407-a14758004af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:51.405831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68762049-f003-4ff9-9407-a14758004af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:51.406094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68762049-f003-4ff9-9407-a14758004af4 admin admin] PATH_INFO: `/v3/projects/c52c59b5fceb4d259d7484cf7a030217/users/66cc6326557344d8a1d10c7631774151/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:51.408193 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68762049-f003-4ff9-9407-a14758004af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52c59b5fceb4d259d7484cf7a030217, user_id=66cc6326557344d8a1d10c7631774151, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:51.411350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68762049-f003-4ff9-9407-a14758004af4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:51.427858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1007/2022] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:51 2022] PUT /identity/v3/projects/c52c59b5fceb4d259d7484cf7a030217/users/66cc6326557344d8a1d10c7631774151/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:51.439923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91423-83da-4e53-8fa4-675d643b1c28 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:51.440629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91423-83da-4e53-8fa4-675d643b1c28 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:51.441871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f91423-83da-4e53-8fa4-675d643b1c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:51.471775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254386e-c60d-44b2-bf39-5e77218c31ea None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:51.499055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-43f91423-83da-4e53-8fa4-675d643b1c28 None None] MFA Rules not processed for user `66cc6326557344d8a1d10c7631774151`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:51.502367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-43f91423-83da-4e53-8fa4-675d643b1c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:51.576091 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:51.581742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45539d6e-12f0-4848-b36b-ade317dcc192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:51.582615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45539d6e-12f0-4848-b36b-ade317dcc192 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:51.582947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45539d6e-12f0-4848-b36b-ade317dcc192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:51.583586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45539d6e-12f0-4848-b36b-ade317dcc192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:51.622281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1008/2023] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:51.634026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f91423-83da-4e53-8fa4-675d643b1c28 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:51.635323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-43f91423-83da-4e53-8fa4-675d643b1c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:51.673473 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45539d6e-12f0-4848-b36b-ade317dcc192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:51.674949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45539d6e-12f0-4848-b36b-ade317dcc192 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:51.685247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1016/2024] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:51.704288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f91423-83da-4e53-8fa4-675d643b1c28 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:51.708181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bacb3-4e4c-41db-bb70-edb8e4952877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:51.708840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bacb3-4e4c-41db-bb70-edb8e4952877 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:51.709125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bacb3-4e4c-41db-bb70-edb8e4952877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:51.709405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bacb3-4e4c-41db-bb70-edb8e4952877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:51.711461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-570bacb3-4e4c-41db-bb70-edb8e4952877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:51.774421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bacb3-4e4c-41db-bb70-edb8e4952877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:51.775939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bacb3-4e4c-41db-bb70-edb8e4952877 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:51.787043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1009/2025] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:29:51.989563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45539d6e-12f0-4848-b36b-ade317dcc192 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:51.991175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-45539d6e-12f0-4848-b36b-ade317dcc192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:52.005524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45539d6e-12f0-4848-b36b-ade317dcc192 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:52.010373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:52.011377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.011761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.012169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] PATH_INFO: `/v3/projects/91c883732a584bf4bde792b3beed321f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.013480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c883732a584bf4bde792b3beed321f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:52.015852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:52.085227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:52.098689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c883732a584bf4bde792b3beed321f', 'request_id': 'req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:52.112603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c883732a584bf4bde792b3beed321f', 'request_id': 'req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:52.125127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c883732a584bf4bde792b3beed321f', 'request_id': 'req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:52.139399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] The token cache is being invalidate because project 91c883732a584bf4bde792b3beed321f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:29:52.139703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:52.140398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fe1551e0-bb4f-47fd-9d95-1381bc09aa61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:29:52.142780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1017/2026] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:29:51 2022] DELETE /identity/v3/projects/91c883732a584bf4bde792b3beed321f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:52.146956 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc447b0e-6ebd-4a5a-b4de-4b5281d13dd1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.147303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc447b0e-6ebd-4a5a-b4de-4b5281d13dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.147595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc447b0e-6ebd-4a5a-b4de-4b5281d13dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.178029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-dc447b0e-6ebd-4a5a-b4de-4b5281d13dd1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:52.180089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dc447b0e-6ebd-4a5a-b4de-4b5281d13dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:52.247206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1010/2027] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:52.255262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d758b88-3cf4-4022-a603-5a49cb29ff78 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.255720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d758b88-3cf4-4022-a603-5a49cb29ff78 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.256032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d758b88-3cf4-4022-a603-5a49cb29ff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.275229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6d758b88-3cf4-4022-a603-5a49cb29ff78 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:52.276507 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6d758b88-3cf4-4022-a603-5a49cb29ff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:52.285447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1018/2028] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:52.289999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc447b0e-6ebd-4a5a-b4de-4b5281d13dd1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:52.300800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc447b0e-6ebd-4a5a-b4de-4b5281d13dd1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:52.306765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6a69b-c803-4161-a591-9be130c4d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:52.307418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6a69b-c803-4161-a591-9be130c4d31f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.307699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6a69b-c803-4161-a591-9be130c4d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.307973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6a69b-c803-4161-a591-9be130c4d31f admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.308787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6a69b-c803-4161-a591-9be130c4d31f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:29:52.309089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6a69b-c803-4161-a591-9be130c4d31f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:52.310930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6a69b-c803-4161-a591-9be130c4d31f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:52.323693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1011/2029] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:29:52.328738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d758b88-3cf4-4022-a603-5a49cb29ff78 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:52.338367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d758b88-3cf4-4022-a603-5a49cb29ff78 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:52.343995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35c9e7-63f1-477a-ae95-e4ebe3ae97c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:52.344726 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35c9e7-63f1-477a-ae95-e4ebe3ae97c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.345008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35c9e7-63f1-477a-ae95-e4ebe3ae97c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.345279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35c9e7-63f1-477a-ae95-e4ebe3ae97c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.345981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35c9e7-63f1-477a-ae95-e4ebe3ae97c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:52.347890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35c9e7-63f1-477a-ae95-e4ebe3ae97c8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:52.376467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1019/2030] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:52 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:52.380717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6a69b-c803-4161-a591-9be130c4d31f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:52.391238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6a69b-c803-4161-a591-9be130c4d31f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:52.409790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:52.452358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28106e3-c58c-4e65-8591-2f34acbdd880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:52.453044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28106e3-c58c-4e65-8591-2f34acbdd880 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.453421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28106e3-c58c-4e65-8591-2f34acbdd880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.453701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28106e3-c58c-4e65-8591-2f34acbdd880 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.454404 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28106e3-c58c-4e65-8591-2f34acbdd880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:52.456394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28106e3-c58c-4e65-8591-2f34acbdd880 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:52.480517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1012/2031] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:52 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:52.482549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35c9e7-63f1-477a-ae95-e4ebe3ae97c8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:52.494361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35c9e7-63f1-477a-ae95-e4ebe3ae97c8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:52.499395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6568e35-1090-49a6-b37f-3d710a566d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:52.500089 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6568e35-1090-49a6-b37f-3d710a566d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.500513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6568e35-1090-49a6-b37f-3d710a566d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.500792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6568e35-1090-49a6-b37f-3d710a566d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.501526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6568e35-1090-49a6-b37f-3d710a566d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:52.503139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6568e35-1090-49a6-b37f-3d710a566d2e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:52.518399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1020/2032] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:52.519555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28106e3-c58c-4e65-8591-2f34acbdd880 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:52.530007 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28106e3-c58c-4e65-8591-2f34acbdd880 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:52.534961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde608fc-15a5-47d0-9a6b-8bd7c49b64ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:52.535696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde608fc-15a5-47d0-9a6b-8bd7c49b64ee admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.535917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde608fc-15a5-47d0-9a6b-8bd7c49b64ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.536224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde608fc-15a5-47d0-9a6b-8bd7c49b64ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.536984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde608fc-15a5-47d0-9a6b-8bd7c49b64ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:52.538691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde608fc-15a5-47d0-9a6b-8bd7c49b64ee admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:52.558571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1013/2033] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:52.562965 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6568e35-1090-49a6-b37f-3d710a566d2e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:52.573280 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6568e35-1090-49a6-b37f-3d710a566d2e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:52.578530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efffe3-035d-43f1-a022-35dea8a89246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:52.579437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efffe3-035d-43f1-a022-35dea8a89246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.579719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efffe3-035d-43f1-a022-35dea8a89246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.579999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efffe3-035d-43f1-a022-35dea8a89246 admin admin] PATH_INFO: `/v3/projects/d7bb0bc84aa14358902dbc80d835b16a/users/03d66292a4304b9f99c365159b42ffac/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.606634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efffe3-035d-43f1-a022-35dea8a89246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bb0bc84aa14358902dbc80d835b16a, user_id=03d66292a4304b9f99c365159b42ffac, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:52.609895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efffe3-035d-43f1-a022-35dea8a89246 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:52.625797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1021/2034] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:52 2022] PUT /identity/v3/projects/d7bb0bc84aa14358902dbc80d835b16a/users/03d66292a4304b9f99c365159b42ffac/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:52.645035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073ec15-47b6-4f65-bbb0-31bae3cfcfc1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.645450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073ec15-47b6-4f65-bbb0-31bae3cfcfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.645828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073ec15-47b6-4f65-bbb0-31bae3cfcfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.673149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e073ec15-47b6-4f65-bbb0-31bae3cfcfc1 None None] MFA Rules not processed for user `03d66292a4304b9f99c365159b42ffac`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:52.674493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e073ec15-47b6-4f65-bbb0-31bae3cfcfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:52.748975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1014/2035] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:29:52.753659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efffe3-035d-43f1-a022-35dea8a89246 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:52.817159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efffe3-035d-43f1-a022-35dea8a89246 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:52.821907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32c392-aa3e-4036-9107-46de032a26c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:52.822569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32c392-aa3e-4036-9107-46de032a26c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.822850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32c392-aa3e-4036-9107-46de032a26c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.823124 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32c392-aa3e-4036-9107-46de032a26c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.823839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32c392-aa3e-4036-9107-46de032a26c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:52.825791 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32c392-aa3e-4036-9107-46de032a26c9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:52.853239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1022/2036] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:52 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:52.858522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073ec15-47b6-4f65-bbb0-31bae3cfcfc1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:52.870187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073ec15-47b6-4f65-bbb0-31bae3cfcfc1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:52.929493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f00b-47e1-438c-bc19-df68efccb58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:52.930221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f00b-47e1-438c-bc19-df68efccb58e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.930508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f00b-47e1-438c-bc19-df68efccb58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.930785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f00b-47e1-438c-bc19-df68efccb58e admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.931485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f00b-47e1-438c-bc19-df68efccb58e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:52.933465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f00b-47e1-438c-bc19-df68efccb58e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:52.957857 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1015/2037] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:52 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:52.959082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32c392-aa3e-4036-9107-46de032a26c9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:52.971369 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32c392-aa3e-4036-9107-46de032a26c9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:52.977396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a96fc8-5848-46b4-9e7c-4e89f3e94dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:52.978109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a96fc8-5848-46b4-9e7c-4e89f3e94dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:52.978374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a96fc8-5848-46b4-9e7c-4e89f3e94dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:52.978673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a96fc8-5848-46b4-9e7c-4e89f3e94dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:52.979422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a96fc8-5848-46b4-9e7c-4e89f3e94dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:52.981098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a96fc8-5848-46b4-9e7c-4e89f3e94dbb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:52.994003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1023/2038] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:52.998066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f00b-47e1-438c-bc19-df68efccb58e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:53.012107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f00b-47e1-438c-bc19-df68efccb58e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:53.017693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571a7a7-a75c-4cb8-84ef-e243868b64f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:53.018394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a7a7-a75c-4cb8-84ef-e243868b64f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.018845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a7a7-a75c-4cb8-84ef-e243868b64f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.019131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a7a7-a75c-4cb8-84ef-e243868b64f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.019878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571a7a7-a75c-4cb8-84ef-e243868b64f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:53.021639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571a7a7-a75c-4cb8-84ef-e243868b64f1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:53.036754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1016/2039] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:53.038532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a96fc8-5848-46b4-9e7c-4e89f3e94dbb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:53.050548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a96fc8-5848-46b4-9e7c-4e89f3e94dbb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:53.056319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5800e-ad60-472a-b955-a870cb55577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:53.057393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5800e-ad60-472a-b955-a870cb55577e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.057781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5800e-ad60-472a-b955-a870cb55577e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.058131 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5800e-ad60-472a-b955-a870cb55577e admin admin] PATH_INFO: `/v3/projects/12bbcc274a074461ae626d84e2641851/users/d4d2139590d7419fa48e790a54ef760e/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.075514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5800e-ad60-472a-b955-a870cb55577e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12bbcc274a074461ae626d84e2641851, user_id=d4d2139590d7419fa48e790a54ef760e, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:53.078387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5800e-ad60-472a-b955-a870cb55577e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:53.105291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1024/2040] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:53 2022] PUT /identity/v3/projects/12bbcc274a074461ae626d84e2641851/users/d4d2139590d7419fa48e790a54ef760e/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:29:53.107867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fa057-4271-4681-9b4e-78cdfe364b3b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.108350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fa057-4271-4681-9b4e-78cdfe364b3b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.109281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fa057-4271-4681-9b4e-78cdfe364b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.124654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:53.149033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fa4fa057-4271-4681-9b4e-78cdfe364b3b None None] MFA Rules not processed for user `d4d2139590d7419fa48e790a54ef760e`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:53.150337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fa4fa057-4271-4681-9b4e-78cdfe364b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:53.232582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1017/2041] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:53.236870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5800e-ad60-472a-b955-a870cb55577e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:53.254047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:53.314875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5800e-ad60-472a-b955-a870cb55577e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:53.319489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189120bc-7f27-45ff-83af-2f5a87b94c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:53.320116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189120bc-7f27-45ff-83af-2f5a87b94c31 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.320398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189120bc-7f27-45ff-83af-2f5a87b94c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.320674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189120bc-7f27-45ff-83af-2f5a87b94c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.321378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189120bc-7f27-45ff-83af-2f5a87b94c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:53.323289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189120bc-7f27-45ff-83af-2f5a87b94c31 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:53.351110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1025/2042] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:29:53 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:29:53.354522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fa057-4271-4681-9b4e-78cdfe364b3b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:53.365664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fa057-4271-4681-9b4e-78cdfe364b3b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:53.422917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ade3-65a6-42e8-8b70-254d360b2cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:53.423645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ade3-65a6-42e8-8b70-254d360b2cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.423875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ade3-65a6-42e8-8b70-254d360b2cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.424184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ade3-65a6-42e8-8b70-254d360b2cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.424885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90ade3-65a6-42e8-8b70-254d360b2cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:53.426941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90ade3-65a6-42e8-8b70-254d360b2cb3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:53.448308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1018/2043] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:29:53 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:29:53.452653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189120bc-7f27-45ff-83af-2f5a87b94c31 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:53.463413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189120bc-7f27-45ff-83af-2f5a87b94c31 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:53.468571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef93b4-98d7-4138-a8c5-6a23031cdea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:53.469309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef93b4-98d7-4138-a8c5-6a23031cdea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.469656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef93b4-98d7-4138-a8c5-6a23031cdea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.470014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef93b4-98d7-4138-a8c5-6a23031cdea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.470836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef93b4-98d7-4138-a8c5-6a23031cdea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:53.472540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef93b4-98d7-4138-a8c5-6a23031cdea4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:53.484666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1026/2044] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:29:53.488802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ade3-65a6-42e8-8b70-254d360b2cb3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:53.499988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ade3-65a6-42e8-8b70-254d360b2cb3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:53.505487 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934adeab-e9b9-439b-8ce1-0c28063e2d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:53.506400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934adeab-e9b9-439b-8ce1-0c28063e2d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.506683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934adeab-e9b9-439b-8ce1-0c28063e2d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.506964 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934adeab-e9b9-439b-8ce1-0c28063e2d3f admin admin] PATH_INFO: `/v3/projects/1726bc1ca4034aff8ecfa5538f849364/users/8925214a53a043d495defe7cfbdb5227/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.522892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934adeab-e9b9-439b-8ce1-0c28063e2d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1726bc1ca4034aff8ecfa5538f849364, user_id=8925214a53a043d495defe7cfbdb5227, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:53.525633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934adeab-e9b9-439b-8ce1-0c28063e2d3f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:53.541418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1019/2045] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:53 2022] PUT /identity/v3/projects/1726bc1ca4034aff8ecfa5538f849364/users/8925214a53a043d495defe7cfbdb5227/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:53.545704 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef93b4-98d7-4138-a8c5-6a23031cdea4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:53.555825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef93b4-98d7-4138-a8c5-6a23031cdea4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:53.624927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019961b4-5748-4a66-81f9-ad92f0f6abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:53.625628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019961b4-5748-4a66-81f9-ad92f0f6abe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.625907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019961b4-5748-4a66-81f9-ad92f0f6abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.626181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019961b4-5748-4a66-81f9-ad92f0f6abe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.626908 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019961b4-5748-4a66-81f9-ad92f0f6abe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:53.628584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019961b4-5748-4a66-81f9-ad92f0f6abe1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:53.638784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1027/2046] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:29:53.643206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934adeab-e9b9-439b-8ce1-0c28063e2d3f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:53.656776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934adeab-e9b9-439b-8ce1-0c28063e2d3f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:53.662331 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d444d4e-be70-4397-b362-55c41d7c9efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:53.663266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d444d4e-be70-4397-b362-55c41d7c9efe admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.663559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d444d4e-be70-4397-b362-55c41d7c9efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.663817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d444d4e-be70-4397-b362-55c41d7c9efe admin admin] PATH_INFO: `/v3/projects/1726bc1ca4034aff8ecfa5538f849364/users/8925214a53a043d495defe7cfbdb5227/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.666202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d444d4e-be70-4397-b362-55c41d7c9efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1726bc1ca4034aff8ecfa5538f849364, user_id=8925214a53a043d495defe7cfbdb5227, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:53.669058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d444d4e-be70-4397-b362-55c41d7c9efe admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:53.689901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1020/2047] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:29:53 2022] PUT /identity/v3/projects/1726bc1ca4034aff8ecfa5538f849364/users/8925214a53a043d495defe7cfbdb5227/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:29:53.693185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237158-cf05-4d9c-9479-fd79b2a75d5a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.693515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237158-cf05-4d9c-9479-fd79b2a75d5a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.693886 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237158-cf05-4d9c-9479-fd79b2a75d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.734086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b7237158-cf05-4d9c-9479-fd79b2a75d5a None None] MFA Rules not processed for user `8925214a53a043d495defe7cfbdb5227`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:29:53.735372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b7237158-cf05-4d9c-9479-fd79b2a75d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:53.807419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1028/2048] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:29:53.819053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d444d4e-be70-4397-b362-55c41d7c9efe admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:53.820804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4d444d4e-be70-4397-b362-55c41d7c9efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:53.873820 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:53.877999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d444d4e-be70-4397-b362-55c41d7c9efe admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:53.882505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780437c4-aff6-4edc-b6b1-a9704e292495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:53.883498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780437c4-aff6-4edc-b6b1-a9704e292495 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:53.883931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780437c4-aff6-4edc-b6b1-a9704e292495 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:53.884421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780437c4-aff6-4edc-b6b1-a9704e292495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:53.945579 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780437c4-aff6-4edc-b6b1-a9704e292495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:53.947089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780437c4-aff6-4edc-b6b1-a9704e292495 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:53.956757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1021/2049] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:55.992145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237158-cf05-4d9c-9479-fd79b2a75d5a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:55.993548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b7237158-cf05-4d9c-9479-fd79b2a75d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:56.006099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237158-cf05-4d9c-9479-fd79b2a75d5a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:56.010015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006637dc-640d-46a7-8816-3487f9c57fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:56.010713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006637dc-640d-46a7-8816-3487f9c57fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:56.011030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006637dc-640d-46a7-8816-3487f9c57fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:56.012157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006637dc-640d-46a7-8816-3487f9c57fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:56.014052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-006637dc-640d-46a7-8816-3487f9c57fa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:56.019759 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:29:56.079120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006637dc-640d-46a7-8816-3487f9c57fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:56.080652 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006637dc-640d-46a7-8816-3487f9c57fa5 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:56.091125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1029/2050] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:56.772731 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780437c4-aff6-4edc-b6b1-a9704e292495 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:56.793193 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780437c4-aff6-4edc-b6b1-a9704e292495 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:56.797396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693dc21-68e4-4606-9a9c-5cebebe135fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:56.798042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693dc21-68e4-4606-9a9c-5cebebe135fb service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:56.798321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693dc21-68e4-4606-9a9c-5cebebe135fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:56.798588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693dc21-68e4-4606-9a9c-5cebebe135fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:56.800489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d693dc21-68e4-4606-9a9c-5cebebe135fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:29:56.866241 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693dc21-68e4-4606-9a9c-5cebebe135fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:56.867607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693dc21-68e4-4606-9a9c-5cebebe135fb service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:56.877509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1022/2051] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:57.673387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006637dc-640d-46a7-8816-3487f9c57fa5 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:57.682265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006637dc-640d-46a7-8816-3487f9c57fa5 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:57.686092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a8d12-8c3b-4132-a006-5094433727a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:57.686802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a8d12-8c3b-4132-a006-5094433727a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:57.687086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a8d12-8c3b-4132-a006-5094433727a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:57.687356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a8d12-8c3b-4132-a006-5094433727a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:57.745906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a8d12-8c3b-4132-a006-5094433727a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:57.747347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a8d12-8c3b-4132-a006-5094433727a4 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:57.756473 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1030/2052] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:29:58.655662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693dc21-68e4-4606-9a9c-5cebebe135fb service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:29:58.664263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693dc21-68e4-4606-9a9c-5cebebe135fb service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:29:58.670074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2b9f9-ba24-47f0-97e9-4d8788298ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:29:58.670856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2b9f9-ba24-47f0-97e9-4d8788298ddd service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:29:58.671209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2b9f9-ba24-47f0-97e9-4d8788298ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:29:58.671547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2b9f9-ba24-47f0-97e9-4d8788298ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:29:58.682907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2b9f9-ba24-47f0-97e9-4d8788298ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:29:58.684501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2b9f9-ba24-47f0-97e9-4d8788298ddd service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:29:58.694498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1023/2053] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:29:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:02.783997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a8d12-8c3b-4132-a006-5094433727a4 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:02.793441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a8d12-8c3b-4132-a006-5094433727a4 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:02.798024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30a1f0-50c9-497a-b97e-890e51c4002e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:02.798667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a1f0-50c9-497a-b97e-890e51c4002e service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:02.798947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a1f0-50c9-497a-b97e-890e51c4002e service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:02.799249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a1f0-50c9-497a-b97e-890e51c4002e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:02.801302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9b30a1f0-50c9-497a-b97e-890e51c4002e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:02.871208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30a1f0-50c9-497a-b97e-890e51c4002e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:02.871208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30a1f0-50c9-497a-b97e-890e51c4002e service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:02.881653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1031/2054] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:04.565762 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2b9f9-ba24-47f0-97e9-4d8788298ddd service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:04.567208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6aa2b9f9-ba24-47f0-97e9-4d8788298ddd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:04.632287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2b9f9-ba24-47f0-97e9-4d8788298ddd service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:04.637189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:04.638069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:04.638351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:04.638620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] PATH_INFO: `/v3/users/4524a8c31517409b915723cce3140d0b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:04.639794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4524a8c31517409b915723cce3140d0b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:04.641787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:04.673533 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:04.695289 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4524a8c31517409b915723cce3140d0b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:04.710214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4524a8c31517409b915723cce3140d0b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:04.718120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4524a8c31517409b915723cce3140d0b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:04.725434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4524a8c31517409b915723cce3140d0b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:04.726062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4524a8c31517409b915723cce3140d0b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:04.732189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1024/2055] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:04 2022] DELETE /identity/v3/users/4524a8c31517409b915723cce3140d0b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:04.736893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32377a-4d4b-43f5-b44a-d4c05714a2ed None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:04.737363 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32377a-4d4b-43f5-b44a-d4c05714a2ed None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:04.737479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32377a-4d4b-43f5-b44a-d4c05714a2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:04.755044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5d32377a-4d4b-43f5-b44a-d4c05714a2ed None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:04.756265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5d32377a-4d4b-43f5-b44a-d4c05714a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:04.788947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:04.817113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1032/2056] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:04.827051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:04.828791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:04.887609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773cb7-97aa-4312-970c-220090923276 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:04.891719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123450c1-6fca-44eb-bc02-9b1c96062443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:04.892379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123450c1-6fca-44eb-bc02-9b1c96062443 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:04.892658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123450c1-6fca-44eb-bc02-9b1c96062443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:04.892962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123450c1-6fca-44eb-bc02-9b1c96062443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:04.902639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123450c1-6fca-44eb-bc02-9b1c96062443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:04.904344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123450c1-6fca-44eb-bc02-9b1c96062443 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:04.914949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1025/2057] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:05.194530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32377a-4d4b-43f5-b44a-d4c05714a2ed None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:05.196465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5d32377a-4d4b-43f5-b44a-d4c05714a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:05.209424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32377a-4d4b-43f5-b44a-d4c05714a2ed None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:05.214785 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:05.215692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:05.215974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:05.216295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] PATH_INFO: `/v3/projects/d1f2c05ead494663a00e539b006654f2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:05.218218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f2c05ead494663a00e539b006654f2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:05.227715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:05.277213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f2c05ead494663a00e539b006654f2', 'request_id': 'req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.288705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f2c05ead494663a00e539b006654f2', 'request_id': 'req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.296720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f2c05ead494663a00e539b006654f2', 'request_id': 'req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.309960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] The token cache is being invalidate because project d1f2c05ead494663a00e539b006654f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:05.310247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.310917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.312513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1033/2058] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:05 2022] DELETE /identity/v3/projects/d1f2c05ead494663a00e539b006654f2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:05.316529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123450c1-6fca-44eb-bc02-9b1c96062443 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:05.326127 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123450c1-6fca-44eb-bc02-9b1c96062443 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:05.386395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:05.387334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:05.387588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:05.387906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] PATH_INFO: `/v3/users/b52d04ddd21c4b1fbe4c64584504e962` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:05.389130 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52d04ddd21c4b1fbe4c64584504e962)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:05.391014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:05.438474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52d04ddd21c4b1fbe4c64584504e962'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.440159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:05.452497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52d04ddd21c4b1fbe4c64584504e962'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.461421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52d04ddd21c4b1fbe4c64584504e962'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.468890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52d04ddd21c4b1fbe4c64584504e962'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.469504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2386e61-357a-40b3-a9d7-f22fee63c417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52d04ddd21c4b1fbe4c64584504e962'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.475947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1026/2059] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:05 2022] DELETE /identity/v3/users/b52d04ddd21c4b1fbe4c64584504e962 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:05.842806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:05.844383 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:05.857546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bb4ae-4cc9-403c-9476-2fb2a68ec14d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:05.917851 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:05.918720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:05.919125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:05.919401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] PATH_INFO: `/v3/projects/5af0f304dce24a89b17bc7698ed7f315` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:05.920670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af0f304dce24a89b17bc7698ed7f315)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:05.922586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:05.975691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af0f304dce24a89b17bc7698ed7f315', 'request_id': 'req-73e550d8-a2da-453a-95a8-95902436a169'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.985124 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af0f304dce24a89b17bc7698ed7f315', 'request_id': 'req-73e550d8-a2da-453a-95a8-95902436a169'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.992218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af0f304dce24a89b17bc7698ed7f315', 'request_id': 'req-73e550d8-a2da-453a-95a8-95902436a169'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:05.994639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:06.004623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] The token cache is being invalidate because project 5af0f304dce24a89b17bc7698ed7f315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:06.004929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:06.005885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-73e550d8-a2da-453a-95a8-95902436a169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:06.010967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1034/2060] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:05 2022] DELETE /identity/v3/projects/5af0f304dce24a89b17bc7698ed7f315 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:06.012926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907c116-73ca-46ab-897a-1bda98538c73 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.013399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907c116-73ca-46ab-897a-1bda98538c73 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.013612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907c116-73ca-46ab-897a-1bda98538c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.033510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c907c116-73ca-46ab-897a-1bda98538c73 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:06.035426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c907c116-73ca-46ab-897a-1bda98538c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:06.099644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1027/2061] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:06.107530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a82d8c-5311-41c6-b883-f19bc3aa0c82 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.107936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a82d8c-5311-41c6-b883-f19bc3aa0c82 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.108312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a82d8c-5311-41c6-b883-f19bc3aa0c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.127765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-62a82d8c-5311-41c6-b883-f19bc3aa0c82 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:06.136297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-62a82d8c-5311-41c6-b883-f19bc3aa0c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:06.137904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1035/2062] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:06.142160 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907c116-73ca-46ab-897a-1bda98538c73 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.152036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907c116-73ca-46ab-897a-1bda98538c73 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:06.157153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775146-7a69-48b9-8554-3b263096dfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:06.157839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775146-7a69-48b9-8554-3b263096dfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.158125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775146-7a69-48b9-8554-3b263096dfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.158633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775146-7a69-48b9-8554-3b263096dfe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.159384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f775146-7a69-48b9-8554-3b263096dfe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:06.159696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f775146-7a69-48b9-8554-3b263096dfe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:06.161381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f775146-7a69-48b9-8554-3b263096dfe6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:06.174243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1028/2063] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:30:06.178712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a82d8c-5311-41c6-b883-f19bc3aa0c82 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.188678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a82d8c-5311-41c6-b883-f19bc3aa0c82 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:06.194581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b58ac-ef7b-413c-9dad-e7ae2244c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:06.195242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b58ac-ef7b-413c-9dad-e7ae2244c7ca admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.195532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b58ac-ef7b-413c-9dad-e7ae2244c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.195817 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b58ac-ef7b-413c-9dad-e7ae2244c7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.196561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b58ac-ef7b-413c-9dad-e7ae2244c7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:06.198533 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b58ac-ef7b-413c-9dad-e7ae2244c7ca admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:06.231237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1036/2064] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:06 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:06.233061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775146-7a69-48b9-8554-3b263096dfe6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.243566 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775146-7a69-48b9-8554-3b263096dfe6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:06.302761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9e5f3-c23b-43e5-b55f-4966e258dc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:06.303737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9e5f3-c23b-43e5-b55f-4966e258dc8b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.304094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9e5f3-c23b-43e5-b55f-4966e258dc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.304412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9e5f3-c23b-43e5-b55f-4966e258dc8b admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.305201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9e5f3-c23b-43e5-b55f-4966e258dc8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:06.307191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9e5f3-c23b-43e5-b55f-4966e258dc8b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:06.329156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1029/2065] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:06 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:06.333679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b58ac-ef7b-413c-9dad-e7ae2244c7ca admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.343916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b58ac-ef7b-413c-9dad-e7ae2244c7ca admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:06.348890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093ff17-5235-46b0-8827-10a540f1cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:06.349594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093ff17-5235-46b0-8827-10a540f1cda9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.349867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093ff17-5235-46b0-8827-10a540f1cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.350161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093ff17-5235-46b0-8827-10a540f1cda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.350887 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093ff17-5235-46b0-8827-10a540f1cda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:06.352538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093ff17-5235-46b0-8827-10a540f1cda9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:06.363291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1037/2066] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:06.367387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9e5f3-c23b-43e5-b55f-4966e258dc8b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.378575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9e5f3-c23b-43e5-b55f-4966e258dc8b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:06.384264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4fb99-561d-40d4-b83d-fb72f597ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:06.384953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4fb99-561d-40d4-b83d-fb72f597ecce admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.385273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4fb99-561d-40d4-b83d-fb72f597ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.385582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4fb99-561d-40d4-b83d-fb72f597ecce admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.386375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4fb99-561d-40d4-b83d-fb72f597ecce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:06.388155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4fb99-561d-40d4-b83d-fb72f597ecce admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:06.399740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1030/2067] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:06.403871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093ff17-5235-46b0-8827-10a540f1cda9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.416274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093ff17-5235-46b0-8827-10a540f1cda9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:06.422969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbf0f5-9dfa-4c1b-8f8f-7a8c95cf60d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:06.423857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbf0f5-9dfa-4c1b-8f8f-7a8c95cf60d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.424375 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbf0f5-9dfa-4c1b-8f8f-7a8c95cf60d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.425092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbf0f5-9dfa-4c1b-8f8f-7a8c95cf60d6 admin admin] PATH_INFO: `/v3/projects/1be97ca7e5b84202990888c15eb8476d/users/73e0457e00c04869a0ac04546e150b8c/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.443084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbf0f5-9dfa-4c1b-8f8f-7a8c95cf60d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be97ca7e5b84202990888c15eb8476d, user_id=73e0457e00c04869a0ac04546e150b8c, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:06.445865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbf0f5-9dfa-4c1b-8f8f-7a8c95cf60d6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:06.461139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1038/2068] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:06 2022] PUT /identity/v3/projects/1be97ca7e5b84202990888c15eb8476d/users/73e0457e00c04869a0ac04546e150b8c/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:06.472396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9c36e-4a6d-49be-91fe-f9f78a56b2bd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.472687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9c36e-4a6d-49be-91fe-f9f78a56b2bd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.472998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9c36e-4a6d-49be-91fe-f9f78a56b2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.504814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-54a9c36e-4a6d-49be-91fe-f9f78a56b2bd None None] MFA Rules not processed for user `73e0457e00c04869a0ac04546e150b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:06.505950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-54a9c36e-4a6d-49be-91fe-f9f78a56b2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:06.528089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:06.577194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1031/2069] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:06.581949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbf0f5-9dfa-4c1b-8f8f-7a8c95cf60d6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.660356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbf0f5-9dfa-4c1b-8f8f-7a8c95cf60d6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:06.665919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4333192-dc38-4d68-8684-74ad98d3fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:06.666580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4333192-dc38-4d68-8684-74ad98d3fa91 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.666859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4333192-dc38-4d68-8684-74ad98d3fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.667136 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4333192-dc38-4d68-8684-74ad98d3fa91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.667825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4333192-dc38-4d68-8684-74ad98d3fa91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:06.669774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4333192-dc38-4d68-8684-74ad98d3fa91 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:06.697804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1039/2070] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:06 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:06.702027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9c36e-4a6d-49be-91fe-f9f78a56b2bd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.713475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9c36e-4a6d-49be-91fe-f9f78a56b2bd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:06.777360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ca8e5-7076-4b5f-a04d-d0ccbc632a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:06.778201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ca8e5-7076-4b5f-a04d-d0ccbc632a41 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.778538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ca8e5-7076-4b5f-a04d-d0ccbc632a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.778883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ca8e5-7076-4b5f-a04d-d0ccbc632a41 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.779929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ca8e5-7076-4b5f-a04d-d0ccbc632a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:06.782961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ca8e5-7076-4b5f-a04d-d0ccbc632a41 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:06.814152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1032/2071] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:06 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:06.820390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4333192-dc38-4d68-8684-74ad98d3fa91 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.835118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4333192-dc38-4d68-8684-74ad98d3fa91 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:06.840914 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e8cd1-70e2-4201-88b6-bb5b78ca9327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:06.841603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e8cd1-70e2-4201-88b6-bb5b78ca9327 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.841887 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e8cd1-70e2-4201-88b6-bb5b78ca9327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.842159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e8cd1-70e2-4201-88b6-bb5b78ca9327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.843193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e8cd1-70e2-4201-88b6-bb5b78ca9327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:06.844540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e8cd1-70e2-4201-88b6-bb5b78ca9327 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:06.856148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1040/2072] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:06.860406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ca8e5-7076-4b5f-a04d-d0ccbc632a41 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.875371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ca8e5-7076-4b5f-a04d-d0ccbc632a41 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:06.887796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d016b8-7fa3-42ba-ac13-e572943b1042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:06.888905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d016b8-7fa3-42ba-ac13-e572943b1042 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:06.889262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d016b8-7fa3-42ba-ac13-e572943b1042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:06.889573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d016b8-7fa3-42ba-ac13-e572943b1042 admin admin] PATH_INFO: `/v3/projects/2a0527b5912540a382cf43f6e36faaa9/users/f7e21e67223243398fe6df208a65dacc/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:06.909860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d016b8-7fa3-42ba-ac13-e572943b1042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0527b5912540a382cf43f6e36faaa9, user_id=f7e21e67223243398fe6df208a65dacc, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:06.912651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d016b8-7fa3-42ba-ac13-e572943b1042 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:06.927883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1033/2073] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:06 2022] PUT /identity/v3/projects/2a0527b5912540a382cf43f6e36faaa9/users/f7e21e67223243398fe6df208a65dacc/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:06.932055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e8cd1-70e2-4201-88b6-bb5b78ca9327 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:06.947616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e8cd1-70e2-4201-88b6-bb5b78ca9327 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:07.008988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103f087-7bde-4c49-87d1-515788dd457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:07.009679 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f087-7bde-4c49-87d1-515788dd457d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:07.010215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f087-7bde-4c49-87d1-515788dd457d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:07.010545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f087-7bde-4c49-87d1-515788dd457d admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:07.011286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103f087-7bde-4c49-87d1-515788dd457d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:07.013038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103f087-7bde-4c49-87d1-515788dd457d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:07.016129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:07.030138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1041/2074] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:07.031403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d016b8-7fa3-42ba-ac13-e572943b1042 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:07.042603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d016b8-7fa3-42ba-ac13-e572943b1042 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:07.047474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8108eda-4487-4156-a9bd-cca6d3e1bcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:07.048382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8108eda-4487-4156-a9bd-cca6d3e1bcc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:07.048725 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8108eda-4487-4156-a9bd-cca6d3e1bcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:07.049251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8108eda-4487-4156-a9bd-cca6d3e1bcc0 admin admin] PATH_INFO: `/v3/projects/2a0527b5912540a382cf43f6e36faaa9/users/f7e21e67223243398fe6df208a65dacc/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:07.051491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8108eda-4487-4156-a9bd-cca6d3e1bcc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0527b5912540a382cf43f6e36faaa9, user_id=f7e21e67223243398fe6df208a65dacc, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:07.054378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8108eda-4487-4156-a9bd-cca6d3e1bcc0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:07.075716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1034/2075] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:07 2022] PUT /identity/v3/projects/2a0527b5912540a382cf43f6e36faaa9/users/f7e21e67223243398fe6df208a65dacc/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:07.078592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe79dd6-5dbd-4272-bbe0-8124cf8e5070 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:07.079085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe79dd6-5dbd-4272-bbe0-8124cf8e5070 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:07.079357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe79dd6-5dbd-4272-bbe0-8124cf8e5070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:07.111580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-afe79dd6-5dbd-4272-bbe0-8124cf8e5070 None None] MFA Rules not processed for user `f7e21e67223243398fe6df208a65dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:07.112840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-afe79dd6-5dbd-4272-bbe0-8124cf8e5070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:07.197074 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1042/2076] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:07.208806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8108eda-4487-4156-a9bd-cca6d3e1bcc0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:07.210592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b8108eda-4487-4156-a9bd-cca6d3e1bcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:07.269975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8108eda-4487-4156-a9bd-cca6d3e1bcc0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:07.274043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3def-3931-4a5d-849e-4849b9e85698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:07.274682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3def-3931-4a5d-849e-4849b9e85698 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:07.274968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3def-3931-4a5d-849e-4849b9e85698 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:07.275245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3def-3931-4a5d-849e-4849b9e85698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:07.285503 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b3def-3931-4a5d-849e-4849b9e85698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:07.286995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b3def-3931-4a5d-849e-4849b9e85698 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:07.308404 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1035/2077] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:07.371585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe79dd6-5dbd-4272-bbe0-8124cf8e5070 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:07.382564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe79dd6-5dbd-4272-bbe0-8124cf8e5070 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:07.386923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b4a06-5fa4-4339-87d5-38b4254506cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:07.387562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b4a06-5fa4-4339-87d5-38b4254506cc service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:07.387839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b4a06-5fa4-4339-87d5-38b4254506cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:07.388158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b4a06-5fa4-4339-87d5-38b4254506cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:07.446758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b4a06-5fa4-4339-87d5-38b4254506cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:07.448342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b4a06-5fa4-4339-87d5-38b4254506cc service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:07.458585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1043/2078] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:11.439224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3def-3931-4a5d-849e-4849b9e85698 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:11.440831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9f3b3def-3931-4a5d-849e-4849b9e85698 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:11.460093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:11.511114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3def-3931-4a5d-849e-4849b9e85698 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:11.515918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:11.516830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:11.517117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:11.517395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] PATH_INFO: `/v3/users/c2b148e26cb94afab1723583442ca53a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:11.518592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b148e26cb94afab1723583442ca53a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:11.520559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:11.575356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b148e26cb94afab1723583442ca53a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:11.590714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b148e26cb94afab1723583442ca53a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:11.599699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b148e26cb94afab1723583442ca53a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:11.607369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b148e26cb94afab1723583442ca53a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:11.608058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b148e26cb94afab1723583442ca53a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:11.614187 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1036/2079] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:11 2022] DELETE /identity/v3/users/c2b148e26cb94afab1723583442ca53a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:11.618955 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38224bb6-11b9-440d-bc9d-4e9386794508 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:11.619438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38224bb6-11b9-440d-bc9d-4e9386794508 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:11.619526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38224bb6-11b9-440d-bc9d-4e9386794508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:11.639663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-38224bb6-11b9-440d-bc9d-4e9386794508 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:11.640829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-38224bb6-11b9-440d-bc9d-4e9386794508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:11.709938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1044/2080] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:11.721747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:11.723596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:11.787524 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f23915-c24e-4d16-85b6-c974c848e549 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:11.792375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab777b1-edfb-4e4c-a4f7-965febf4aab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:11.793035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab777b1-edfb-4e4c-a4f7-965febf4aab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:11.793324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab777b1-edfb-4e4c-a4f7-965febf4aab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:11.793599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab777b1-edfb-4e4c-a4f7-965febf4aab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:11.803549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab777b1-edfb-4e4c-a4f7-965febf4aab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:11.805357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab777b1-edfb-4e4c-a4f7-965febf4aab1 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:11.815350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1037/2081] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:12.190870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38224bb6-11b9-440d-bc9d-4e9386794508 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:12.192439 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-38224bb6-11b9-440d-bc9d-4e9386794508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:12.207233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38224bb6-11b9-440d-bc9d-4e9386794508 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:12.214965 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:12.215970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:12.216234 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:12.216504 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] PATH_INFO: `/v3/projects/26df21233a23488f83456b30080d7e7b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:12.217811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26df21233a23488f83456b30080d7e7b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:12.219729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:12.237912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:12.270224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26df21233a23488f83456b30080d7e7b', 'request_id': 'req-eae1db87-20f1-496e-8452-a2eeccf325c0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.279378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26df21233a23488f83456b30080d7e7b', 'request_id': 'req-eae1db87-20f1-496e-8452-a2eeccf325c0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.285953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26df21233a23488f83456b30080d7e7b', 'request_id': 'req-eae1db87-20f1-496e-8452-a2eeccf325c0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.296821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] The token cache is being invalidate because project 26df21233a23488f83456b30080d7e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:12.297109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.297753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.299308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1045/2082] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:12 2022] DELETE /identity/v3/projects/26df21233a23488f83456b30080d7e7b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:12.307128 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab777b1-edfb-4e4c-a4f7-965febf4aab1 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:12.316792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab777b1-edfb-4e4c-a4f7-965febf4aab1 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:12.351935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:12.377581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:12.378473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:12.378750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:12.379023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] PATH_INFO: `/v3/users/d6535f2e0f1e4f8294b407d612b443f2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:12.380246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6535f2e0f1e4f8294b407d612b443f2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:12.382194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:12.440120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6535f2e0f1e4f8294b407d612b443f2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.453951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6535f2e0f1e4f8294b407d612b443f2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.463379 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6535f2e0f1e4f8294b407d612b443f2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.470686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6535f2e0f1e4f8294b407d612b443f2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.471313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6535f2e0f1e4f8294b407d612b443f2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.478957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1038/2083] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:12 2022] DELETE /identity/v3/users/d6535f2e0f1e4f8294b407d612b443f2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:12.775555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:12.777183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:12.790731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1db87-20f1-496e-8452-a2eeccf325c0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:12.850000 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:12.850875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:12.851158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:12.851565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] PATH_INFO: `/v3/projects/49978bced8fd4669b64ba93eb8d4e53e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:12.852806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49978bced8fd4669b64ba93eb8d4e53e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:12.854759 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:12.903207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49978bced8fd4669b64ba93eb8d4e53e', 'request_id': 'req-d301761a-b2bb-4d61-86ef-5872174055e0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.911832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49978bced8fd4669b64ba93eb8d4e53e', 'request_id': 'req-d301761a-b2bb-4d61-86ef-5872174055e0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.918568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49978bced8fd4669b64ba93eb8d4e53e', 'request_id': 'req-d301761a-b2bb-4d61-86ef-5872174055e0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.929646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] The token cache is being invalidate because project 49978bced8fd4669b64ba93eb8d4e53e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:12.929943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.930577 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:12.932333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1046/2084] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:12 2022] DELETE /identity/v3/projects/49978bced8fd4669b64ba93eb8d4e53e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:12.936536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:12.937837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:12.951487 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd613c-9c7a-49a9-885c-f2fa33e32ef6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:13.009610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:13.010496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:13.010786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:13.011065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] PATH_INFO: `/v3/users/ad7f8cd4d51947d7a236b72d06b0e5a5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:13.012356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7f8cd4d51947d7a236b72d06b0e5a5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:13.014316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:13.063783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7f8cd4d51947d7a236b72d06b0e5a5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:13.072381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:13.078000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7f8cd4d51947d7a236b72d06b0e5a5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:13.091616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7f8cd4d51947d7a236b72d06b0e5a5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:13.102252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7f8cd4d51947d7a236b72d06b0e5a5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:13.102991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6403f284-01b1-487e-87d9-8c2ae2170708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7f8cd4d51947d7a236b72d06b0e5a5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:13.109590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1039/2085] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:12 2022] DELETE /identity/v3/users/ad7f8cd4d51947d7a236b72d06b0e5a5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:13.528886 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:13.530588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:13.547574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301761a-b2bb-4d61-86ef-5872174055e0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:13.592448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:13.622586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:13.623469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:13.623744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:13.624021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] PATH_INFO: `/v3/projects/986e0c797f2c4a51842710ccb5f699b4` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:13.625382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=986e0c797f2c4a51842710ccb5f699b4)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:13.627348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:13.680691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986e0c797f2c4a51842710ccb5f699b4', 'request_id': 'req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:13.691467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986e0c797f2c4a51842710ccb5f699b4', 'request_id': 'req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:13.698593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986e0c797f2c4a51842710ccb5f699b4', 'request_id': 'req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:13.709560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] The token cache is being invalidate because project 986e0c797f2c4a51842710ccb5f699b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:13.709844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:13.710499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dae09b5c-8a15-4081-af71-bcbf2c15a6f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:13.713156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1047/2086] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:13 2022] DELETE /identity/v3/projects/986e0c797f2c4a51842710ccb5f699b4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:13.719250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2ad81-2eac-4d6c-a2aa-6a433e009f6d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:13.719731 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2ad81-2eac-4d6c-a2aa-6a433e009f6d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:13.719817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2ad81-2eac-4d6c-a2aa-6a433e009f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:13.743164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ddf2ad81-2eac-4d6c-a2aa-6a433e009f6d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:13.744656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ddf2ad81-2eac-4d6c-a2aa-6a433e009f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:13.818785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1040/2087] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:13.827300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727544-1681-434c-99d5-ddf6250ac429 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:13.827808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727544-1681-434c-99d5-ddf6250ac429 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:13.827808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727544-1681-434c-99d5-ddf6250ac429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:13.848299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b9727544-1681-434c-99d5-ddf6250ac429 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:13.850025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b9727544-1681-434c-99d5-ddf6250ac429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:13.860063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1048/2088] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:13.864783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2ad81-2eac-4d6c-a2aa-6a433e009f6d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:13.883138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2ad81-2eac-4d6c-a2aa-6a433e009f6d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:13.889755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202e375-1b1f-4137-a3e4-54f1043b0005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:13.890628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202e375-1b1f-4137-a3e4-54f1043b0005 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:13.890916 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202e375-1b1f-4137-a3e4-54f1043b0005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:13.891256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202e375-1b1f-4137-a3e4-54f1043b0005 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:13.892500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202e375-1b1f-4137-a3e4-54f1043b0005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:13.892900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202e375-1b1f-4137-a3e4-54f1043b0005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:13.894686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202e375-1b1f-4137-a3e4-54f1043b0005 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:13.917343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1041/2089] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:30:13.922058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727544-1681-434c-99d5-ddf6250ac429 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:13.932526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727544-1681-434c-99d5-ddf6250ac429 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:13.938619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e438ee-c69f-41b7-a3ef-43eb589a72de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:13.939296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e438ee-c69f-41b7-a3ef-43eb589a72de admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:13.940453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e438ee-c69f-41b7-a3ef-43eb589a72de admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:13.940453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e438ee-c69f-41b7-a3ef-43eb589a72de admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:13.940658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e438ee-c69f-41b7-a3ef-43eb589a72de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:13.942505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e438ee-c69f-41b7-a3ef-43eb589a72de admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:13.977106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1049/2090] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:13 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:13.982888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202e375-1b1f-4137-a3e4-54f1043b0005 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:13.993701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202e375-1b1f-4137-a3e4-54f1043b0005 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:14.062767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233efdf2-b793-4642-a89e-3a889d52edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:14.063472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233efdf2-b793-4642-a89e-3a889d52edb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:14.063759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233efdf2-b793-4642-a89e-3a889d52edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:14.068192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233efdf2-b793-4642-a89e-3a889d52edb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:14.069006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233efdf2-b793-4642-a89e-3a889d52edb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:14.071176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233efdf2-b793-4642-a89e-3a889d52edb4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:14.102238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1042/2091] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:13 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:14.104177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e438ee-c69f-41b7-a3ef-43eb589a72de admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:14.124208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e438ee-c69f-41b7-a3ef-43eb589a72de admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:14.130243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc4488-7c4e-4e41-bf85-94a59d9e71ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:14.130946 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc4488-7c4e-4e41-bf85-94a59d9e71ba admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:14.131216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc4488-7c4e-4e41-bf85-94a59d9e71ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:14.131488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc4488-7c4e-4e41-bf85-94a59d9e71ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:14.132256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc4488-7c4e-4e41-bf85-94a59d9e71ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:14.133983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc4488-7c4e-4e41-bf85-94a59d9e71ba admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:14.145759 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1050/2092] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:14.150486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233efdf2-b793-4642-a89e-3a889d52edb4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:14.173032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233efdf2-b793-4642-a89e-3a889d52edb4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:14.180681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01f04-2d19-4e05-8bf1-9e160dae01c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:14.181568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01f04-2d19-4e05-8bf1-9e160dae01c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:14.181862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01f04-2d19-4e05-8bf1-9e160dae01c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:14.182175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01f04-2d19-4e05-8bf1-9e160dae01c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:14.183276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df01f04-2d19-4e05-8bf1-9e160dae01c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:14.185913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df01f04-2d19-4e05-8bf1-9e160dae01c5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:14.200218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1043/2093] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:14.205093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc4488-7c4e-4e41-bf85-94a59d9e71ba admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:14.219171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc4488-7c4e-4e41-bf85-94a59d9e71ba admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:14.225792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ada45-82d8-4c6a-83e4-f0c0b97422cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:14.226830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ada45-82d8-4c6a-83e4-f0c0b97422cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:14.227106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ada45-82d8-4c6a-83e4-f0c0b97422cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:14.227382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ada45-82d8-4c6a-83e4-f0c0b97422cf admin admin] PATH_INFO: `/v3/projects/262379cecac54fadb3ad9b63f2033bf0/users/36ed91ed9b1c4c3993681863d458cc9a/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:14.246862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ada45-82d8-4c6a-83e4-f0c0b97422cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=262379cecac54fadb3ad9b63f2033bf0, user_id=36ed91ed9b1c4c3993681863d458cc9a, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:14.249563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ada45-82d8-4c6a-83e4-f0c0b97422cf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:14.273070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1051/2094] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:14 2022] PUT /identity/v3/projects/262379cecac54fadb3ad9b63f2033bf0/users/36ed91ed9b1c4c3993681863d458cc9a/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:14.283796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5265c25-cae0-47df-9a47-779a3c91d15e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:14.284097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5265c25-cae0-47df-9a47-779a3c91d15e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:14.284390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5265c25-cae0-47df-9a47-779a3c91d15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:14.328923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c5265c25-cae0-47df-9a47-779a3c91d15e None None] MFA Rules not processed for user `36ed91ed9b1c4c3993681863d458cc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:14.329722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c5265c25-cae0-47df-9a47-779a3c91d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:14.385148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:14.438893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1044/2095] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:14.454365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ada45-82d8-4c6a-83e4-f0c0b97422cf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:14.457966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-664ada45-82d8-4c6a-83e4-f0c0b97422cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:14.526193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ada45-82d8-4c6a-83e4-f0c0b97422cf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:14.530033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8e01b-51a1-4bc7-a34b-15233ae377ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:14.530721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8e01b-51a1-4bc7-a34b-15233ae377ef service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:14.530987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8e01b-51a1-4bc7-a34b-15233ae377ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:14.531247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8e01b-51a1-4bc7-a34b-15233ae377ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:14.541498 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8e01b-51a1-4bc7-a34b-15233ae377ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:14.543336 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8e01b-51a1-4bc7-a34b-15233ae377ef service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:14.553497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1052/2096] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:24.433648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=13 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:24.549299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:27.003402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5265c25-cae0-47df-9a47-779a3c91d15e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:27.005238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c5265c25-cae0-47df-9a47-779a3c91d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:27.075276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5265c25-cae0-47df-9a47-779a3c91d15e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:27.079727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:27.080655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:27.080944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:27.081219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] PATH_INFO: `/v3/users/03d66292a4304b9f99c365159b42ffac` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:27.082403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d66292a4304b9f99c365159b42ffac)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:27.084474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:27.132468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d66292a4304b9f99c365159b42ffac'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.146474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d66292a4304b9f99c365159b42ffac'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.158877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d66292a4304b9f99c365159b42ffac'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.167521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d66292a4304b9f99c365159b42ffac'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.168259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d66292a4304b9f99c365159b42ffac'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.175079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1045/2097] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:27 2022] DELETE /identity/v3/users/03d66292a4304b9f99c365159b42ffac => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:27.179768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02692a0a-6e25-42b5-bc03-a3aee4fc994e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:27.180316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02692a0a-6e25-42b5-bc03-a3aee4fc994e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:27.180316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02692a0a-6e25-42b5-bc03-a3aee4fc994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:27.200347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-02692a0a-6e25-42b5-bc03-a3aee4fc994e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:27.201378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-02692a0a-6e25-42b5-bc03-a3aee4fc994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:27.266617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1053/2098] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:27.278280 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:27.279882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:27.348326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a6676-f243-49c6-a074-6db69758973a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:27.352976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ec853-fed3-4bdd-a4a7-00cae301180c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:27.353753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ec853-fed3-4bdd-a4a7-00cae301180c service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:27.353899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ec853-fed3-4bdd-a4a7-00cae301180c service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:27.354245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ec853-fed3-4bdd-a4a7-00cae301180c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:27.364652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ec853-fed3-4bdd-a4a7-00cae301180c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:27.373768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ec853-fed3-4bdd-a4a7-00cae301180c service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:27.381197 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1046/2099] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:27.725114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02692a0a-6e25-42b5-bc03-a3aee4fc994e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:27.726803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-02692a0a-6e25-42b5-bc03-a3aee4fc994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:27.744646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02692a0a-6e25-42b5-bc03-a3aee4fc994e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:27.751120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:27.752134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:27.752418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:27.752693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] PATH_INFO: `/v3/projects/d7bb0bc84aa14358902dbc80d835b16a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:27.753973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7bb0bc84aa14358902dbc80d835b16a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:27.756019 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:27.808617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bb0bc84aa14358902dbc80d835b16a', 'request_id': 'req-7bf67e7b-8342-4286-ab1b-3790d7ea7448'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.818871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bb0bc84aa14358902dbc80d835b16a', 'request_id': 'req-7bf67e7b-8342-4286-ab1b-3790d7ea7448'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.825826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bb0bc84aa14358902dbc80d835b16a', 'request_id': 'req-7bf67e7b-8342-4286-ab1b-3790d7ea7448'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.836497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] The token cache is being invalidate because project d7bb0bc84aa14358902dbc80d835b16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:27.836783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.837499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.839167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1054/2100] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:27 2022] DELETE /identity/v3/projects/d7bb0bc84aa14358902dbc80d835b16a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:27.843623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ec853-fed3-4bdd-a4a7-00cae301180c service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:27.853914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ec853-fed3-4bdd-a4a7-00cae301180c service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:27.872204 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:27.914746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:27.915630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:27.915909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:27.916214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] PATH_INFO: `/v3/users/d4d2139590d7419fa48e790a54ef760e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:27.917553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d2139590d7419fa48e790a54ef760e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:27.919475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:27.977206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d2139590d7419fa48e790a54ef760e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:27.993249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d2139590d7419fa48e790a54ef760e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.002769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d2139590d7419fa48e790a54ef760e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.010259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d2139590d7419fa48e790a54ef760e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.011024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d2139590d7419fa48e790a54ef760e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.017108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1047/2101] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:27 2022] DELETE /identity/v3/users/d4d2139590d7419fa48e790a54ef760e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:28.320278 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:28.321893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:28.336319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf67e7b-8342-4286-ab1b-3790d7ea7448 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:28.400547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:28.401525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:28.402348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:28.402634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] PATH_INFO: `/v3/projects/12bbcc274a074461ae626d84e2641851` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:28.403929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12bbcc274a074461ae626d84e2641851)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:28.405907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:28.439222 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:28.457463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12bbcc274a074461ae626d84e2641851', 'request_id': 'req-eea7b28c-92a3-4803-ac6f-7efe228df795'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.466400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12bbcc274a074461ae626d84e2641851', 'request_id': 'req-eea7b28c-92a3-4803-ac6f-7efe228df795'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.473038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12bbcc274a074461ae626d84e2641851', 'request_id': 'req-eea7b28c-92a3-4803-ac6f-7efe228df795'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.483743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] The token cache is being invalidate because project 12bbcc274a074461ae626d84e2641851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:28.483971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.484641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.486545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1055/2102] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:28 2022] DELETE /identity/v3/projects/12bbcc274a074461ae626d84e2641851 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:28.491271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:28.493500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:28.508296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acaa8c-7e3b-4606-a744-f874ed995459 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:28.568484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:28.569452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:28.569708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:28.570000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] PATH_INFO: `/v3/users/8925214a53a043d495defe7cfbdb5227` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:28.571217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8925214a53a043d495defe7cfbdb5227)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:28.573266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:28.625586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:28.628248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8925214a53a043d495defe7cfbdb5227'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.642411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8925214a53a043d495defe7cfbdb5227'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.652175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8925214a53a043d495defe7cfbdb5227'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.660444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8925214a53a043d495defe7cfbdb5227'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.661531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e873929e-5fe7-412e-b5a6-0d574804f319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8925214a53a043d495defe7cfbdb5227'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:28.667520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1048/2103] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:28 2022] DELETE /identity/v3/users/8925214a53a043d495defe7cfbdb5227 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:28.950739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:28.952706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:28.967761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7b28c-92a3-4803-ac6f-7efe228df795 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:29.040979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:29.042017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.042299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.043177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] PATH_INFO: `/v3/projects/1726bc1ca4034aff8ecfa5538f849364` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.044728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1726bc1ca4034aff8ecfa5538f849364)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:29.046843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:29.117656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1726bc1ca4034aff8ecfa5538f849364', 'request_id': 'req-b1346775-6edd-41e1-9857-865f5b5bd3b0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:29.127291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1726bc1ca4034aff8ecfa5538f849364', 'request_id': 'req-b1346775-6edd-41e1-9857-865f5b5bd3b0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:29.135864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1726bc1ca4034aff8ecfa5538f849364', 'request_id': 'req-b1346775-6edd-41e1-9857-865f5b5bd3b0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:29.152897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] The token cache is being invalidate because project 1726bc1ca4034aff8ecfa5538f849364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:29.152897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:29.152897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b1346775-6edd-41e1-9857-865f5b5bd3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:29.152897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1056/2104] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:28 2022] DELETE /identity/v3/projects/1726bc1ca4034aff8ecfa5538f849364 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:29.155616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd14b-86f1-436f-94b5-2aad50fede69 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.156105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd14b-86f1-436f-94b5-2aad50fede69 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.156195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cd14b-86f1-436f-94b5-2aad50fede69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.175562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8c8cd14b-86f1-436f-94b5-2aad50fede69 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:29.176793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8c8cd14b-86f1-436f-94b5-2aad50fede69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:29.238096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1049/2105] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:29.246110 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c8e0-3265-4b40-b7d7-a00a95da576e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.246403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c8e0-3265-4b40-b7d7-a00a95da576e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.246703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c8e0-3265-4b40-b7d7-a00a95da576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.266114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2230c8e0-3265-4b40-b7d7-a00a95da576e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:29.267334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2230c8e0-3265-4b40-b7d7-a00a95da576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:29.276153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1057/2106] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:29.280535 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cd14b-86f1-436f-94b5-2aad50fede69 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:29.290847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cd14b-86f1-436f-94b5-2aad50fede69 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:29.296443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27b4e1-a658-4f9c-8c55-435546a1392f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:29.297255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27b4e1-a658-4f9c-8c55-435546a1392f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.297543 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27b4e1-a658-4f9c-8c55-435546a1392f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.297822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27b4e1-a658-4f9c-8c55-435546a1392f admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.298570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27b4e1-a658-4f9c-8c55-435546a1392f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:29.298879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27b4e1-a658-4f9c-8c55-435546a1392f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:29.304336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27b4e1-a658-4f9c-8c55-435546a1392f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:29.315606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1050/2107] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:30:29.317990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c8e0-3265-4b40-b7d7-a00a95da576e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:29.327875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c8e0-3265-4b40-b7d7-a00a95da576e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:29.332708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf662c55-7349-4cb3-b661-2050750fc114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:29.333437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf662c55-7349-4cb3-b661-2050750fc114 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.333645 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf662c55-7349-4cb3-b661-2050750fc114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.333918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf662c55-7349-4cb3-b661-2050750fc114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.334699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf662c55-7349-4cb3-b661-2050750fc114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:29.336685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf662c55-7349-4cb3-b661-2050750fc114 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:29.369050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1058/2108] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:29 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:30:29.370916 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27b4e1-a658-4f9c-8c55-435546a1392f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:29.381979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27b4e1-a658-4f9c-8c55-435546a1392f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:29.443189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03793d28-0a7b-4212-a249-84214117f1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:29.443886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03793d28-0a7b-4212-a249-84214117f1ea admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.444209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03793d28-0a7b-4212-a249-84214117f1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.444482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03793d28-0a7b-4212-a249-84214117f1ea admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.445194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03793d28-0a7b-4212-a249-84214117f1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:29.447152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03793d28-0a7b-4212-a249-84214117f1ea admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:29.474096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1051/2109] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:29 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:29.477834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf662c55-7349-4cb3-b661-2050750fc114 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:29.489894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf662c55-7349-4cb3-b661-2050750fc114 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:29.495060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbbab1-c981-4b6f-8bdd-b32c548e60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:29.495737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbbab1-c981-4b6f-8bdd-b32c548e60f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.496057 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbbab1-c981-4b6f-8bdd-b32c548e60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.496339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbbab1-c981-4b6f-8bdd-b32c548e60f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.497085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbbab1-c981-4b6f-8bdd-b32c548e60f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:29.499302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbbab1-c981-4b6f-8bdd-b32c548e60f9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:29.510319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1059/2110] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:29.514605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03793d28-0a7b-4212-a249-84214117f1ea admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:29.524698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03793d28-0a7b-4212-a249-84214117f1ea admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:29.529432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fc2b4-c37e-4343-9ef6-f735d414cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:29.530028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fc2b4-c37e-4343-9ef6-f735d414cb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.530315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fc2b4-c37e-4343-9ef6-f735d414cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.530587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fc2b4-c37e-4343-9ef6-f735d414cb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.531318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fc2b4-c37e-4343-9ef6-f735d414cb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:29.532958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fc2b4-c37e-4343-9ef6-f735d414cb03 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:29.545207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1052/2111] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:29.549299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbbab1-c981-4b6f-8bdd-b32c548e60f9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:29.556853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:29.562480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbbab1-c981-4b6f-8bdd-b32c548e60f9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:29.569927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9731fbd-0bf6-43e7-bf76-f55f6f80cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:29.571479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731fbd-0bf6-43e7-bf76-f55f6f80cd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.572246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731fbd-0bf6-43e7-bf76-f55f6f80cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.572590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731fbd-0bf6-43e7-bf76-f55f6f80cd3e admin admin] PATH_INFO: `/v3/projects/48cc498beca642d7bd9abde2e0ecda45/users/1341931661d54dabb28528adffb45e58/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.587855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9731fbd-0bf6-43e7-bf76-f55f6f80cd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cc498beca642d7bd9abde2e0ecda45, user_id=1341931661d54dabb28528adffb45e58, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:29.590588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9731fbd-0bf6-43e7-bf76-f55f6f80cd3e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:29.604066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1060/2112] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:29 2022] PUT /identity/v3/projects/48cc498beca642d7bd9abde2e0ecda45/users/1341931661d54dabb28528adffb45e58/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:29.615208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b6875-5fe7-4073-a11d-116dc12c4432 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.615492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b6875-5fe7-4073-a11d-116dc12c4432 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.615765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b6875-5fe7-4073-a11d-116dc12c4432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.643059 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-790b6875-5fe7-4073-a11d-116dc12c4432 None None] MFA Rules not processed for user `1341931661d54dabb28528adffb45e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:29.644404 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-790b6875-5fe7-4073-a11d-116dc12c4432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:29.657681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:29.710657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1053/2113] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:30:29.721918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9731fbd-0bf6-43e7-bf76-f55f6f80cd3e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:29.723885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9731fbd-0bf6-43e7-bf76-f55f6f80cd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:29.794123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9731fbd-0bf6-43e7-bf76-f55f6f80cd3e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:29.799775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa470a1a-253c-4432-9879-82971ee779c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:29.800848 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa470a1a-253c-4432-9879-82971ee779c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.801284 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa470a1a-253c-4432-9879-82971ee779c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.801730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa470a1a-253c-4432-9879-82971ee779c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.815338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa470a1a-253c-4432-9879-82971ee779c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:29.818014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa470a1a-253c-4432-9879-82971ee779c7 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:29.830001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1061/2114] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:29.862881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b6875-5fe7-4073-a11d-116dc12c4432 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:29.929343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b6875-5fe7-4073-a11d-116dc12c4432 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:29.934308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:29.935230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:29.935513 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:29.935785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] PATH_INFO: `/v3/users/1341931661d54dabb28528adffb45e58` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:29.937013 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1341931661d54dabb28528adffb45e58)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:29.938972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:29.988584 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1341931661d54dabb28528adffb45e58'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:30.000953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1341931661d54dabb28528adffb45e58'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:30.012229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1341931661d54dabb28528adffb45e58'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:30.019176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1341931661d54dabb28528adffb45e58'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:30.019808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1341931661d54dabb28528adffb45e58'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:30.025830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1054/2115] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:29 2022] DELETE /identity/v3/users/1341931661d54dabb28528adffb45e58 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:30.030581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f4754-5da4-451f-8f80-9decbe5ad063 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:30.030881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f4754-5da4-451f-8f80-9decbe5ad063 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:30.031162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f4754-5da4-451f-8f80-9decbe5ad063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:30.050138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5e4f4754-5da4-451f-8f80-9decbe5ad063 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:30.051351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5e4f4754-5da4-451f-8f80-9decbe5ad063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:30.116788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1062/2116] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:30.126769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:30.128814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:30.178911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:30.206831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0549a-c587-4ec5-ba4e-810d57f957e6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:30.217494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b442e10-f47e-4c61-9fb8-595d1d1aa1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:30.218177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b442e10-f47e-4c61-9fb8-595d1d1aa1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:30.218497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b442e10-f47e-4c61-9fb8-595d1d1aa1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:30.218723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b442e10-f47e-4c61-9fb8-595d1d1aa1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:30.229287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b442e10-f47e-4c61-9fb8-595d1d1aa1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:30.230908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b442e10-f47e-4c61-9fb8-595d1d1aa1a3 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:30.241045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1055/2117] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:30.520518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f4754-5da4-451f-8f80-9decbe5ad063 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:30.522227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5e4f4754-5da4-451f-8f80-9decbe5ad063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:30.534588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f4754-5da4-451f-8f80-9decbe5ad063 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:30.540135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:30.541022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:30.541500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:30.541837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] PATH_INFO: `/v3/projects/48cc498beca642d7bd9abde2e0ecda45` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:30.543525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cc498beca642d7bd9abde2e0ecda45)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:30.545697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:30.599356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cc498beca642d7bd9abde2e0ecda45', 'request_id': 'req-a8bafde5-f0e3-4901-842e-fd0439390c51'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:30.607719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cc498beca642d7bd9abde2e0ecda45', 'request_id': 'req-a8bafde5-f0e3-4901-842e-fd0439390c51'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:30.615260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cc498beca642d7bd9abde2e0ecda45', 'request_id': 'req-a8bafde5-f0e3-4901-842e-fd0439390c51'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:30.627117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] The token cache is being invalidate because project 48cc498beca642d7bd9abde2e0ecda45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:30.627416 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:30.628124 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a8bafde5-f0e3-4901-842e-fd0439390c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:30.632075 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1063/2118] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:30 2022] DELETE /identity/v3/projects/48cc498beca642d7bd9abde2e0ecda45 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:34.105534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b442e10-f47e-4c61-9fb8-595d1d1aa1a3 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:34.107036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4b442e10-f47e-4c61-9fb8-595d1d1aa1a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:34.119614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b442e10-f47e-4c61-9fb8-595d1d1aa1a3 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:34.188092 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:34.189042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:34.189329 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:34.189633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] PATH_INFO: `/v3/users/73e0457e00c04869a0ac04546e150b8c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:34.190887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e0457e00c04869a0ac04546e150b8c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:34.192871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:34.241440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e0457e00c04869a0ac04546e150b8c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.254363 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e0457e00c04869a0ac04546e150b8c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.263172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e0457e00c04869a0ac04546e150b8c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.273349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e0457e00c04869a0ac04546e150b8c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.274321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e0457e00c04869a0ac04546e150b8c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.287727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1056/2119] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:34 2022] DELETE /identity/v3/users/73e0457e00c04869a0ac04546e150b8c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:34.289936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:34.290663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb9ee2-88f7-44b2-83ea-64a5cecfeb50 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:34.291094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb9ee2-88f7-44b2-83ea-64a5cecfeb50 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:34.291167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb9ee2-88f7-44b2-83ea-64a5cecfeb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:34.291351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:34.307089 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:34.315201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-95bb9ee2-88f7-44b2-83ea-64a5cecfeb50 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:34.316864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-95bb9ee2-88f7-44b2-83ea-64a5cecfeb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:34.360142 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:34.364140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ce9e5-81e5-4448-830f-812e11db9c75 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:34.370460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:34.371687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:34.372127 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:34.372465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] PATH_INFO: `/v3/users/e0b3c1b83e3f46a5a2d2593191f118ec` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:34.373904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b3c1b83e3f46a5a2d2593191f118ec)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:34.375854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:34.381259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1064/2120] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:34.391521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb9ee2-88f7-44b2-83ea-64a5cecfeb50 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:34.392895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-95bb9ee2-88f7-44b2-83ea-64a5cecfeb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:34.424707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b3c1b83e3f46a5a2d2593191f118ec'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.438141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b3c1b83e3f46a5a2d2593191f118ec'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.448771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b3c1b83e3f46a5a2d2593191f118ec'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.453566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb9ee2-88f7-44b2-83ea-64a5cecfeb50 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:34.456559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b3c1b83e3f46a5a2d2593191f118ec'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.457244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b3c1b83e3f46a5a2d2593191f118ec'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.457363 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a153f-638d-47be-a43b-9053b338a31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:34.457936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a153f-638d-47be-a43b-9053b338a31a service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:34.458218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a153f-638d-47be-a43b-9053b338a31a service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:34.458628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a153f-638d-47be-a43b-9053b338a31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:34.460605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1c1a153f-638d-47be-a43b-9053b338a31a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:34.467362 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1057/2121] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:34 2022] DELETE /identity/v3/users/e0b3c1b83e3f46a5a2d2593191f118ec => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:34.474130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a153f-638d-47be-a43b-9053b338a31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:34.475581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a153f-638d-47be-a43b-9053b338a31a service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:34.487397 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1065/2122] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:30:34.660413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:34.663910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:34.752926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55c1a4-c5aa-4868-a9fa-a9256f01038b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:34.758164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:34.759057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:34.759341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:34.759617 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] PATH_INFO: `/v3/projects/1d8e7a5f85464feeb943b5da573f0844` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:34.761851 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8e7a5f85464feeb943b5da573f0844)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:34.764512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:34.820949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8e7a5f85464feeb943b5da573f0844', 'request_id': 'req-407ea245-13c5-47e4-a43e-f068890e84ae'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.826992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8e7a5f85464feeb943b5da573f0844', 'request_id': 'req-407ea245-13c5-47e4-a43e-f068890e84ae'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.833461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8e7a5f85464feeb943b5da573f0844', 'request_id': 'req-407ea245-13c5-47e4-a43e-f068890e84ae'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.848870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] The token cache is being invalidate because project 1d8e7a5f85464feeb943b5da573f0844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:34.849162 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.849798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:34.851838 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1058/2123] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:34 2022] DELETE /identity/v3/projects/1d8e7a5f85464feeb943b5da573f0844 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:34.856858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b966ed-a1d2-4d9b-99d8-4762084de80f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:34.857152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b966ed-a1d2-4d9b-99d8-4762084de80f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:34.857430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b966ed-a1d2-4d9b-99d8-4762084de80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:34.875578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-71b966ed-a1d2-4d9b-99d8-4762084de80f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:34.876829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-71b966ed-a1d2-4d9b-99d8-4762084de80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:34.909030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:34.911025 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:34.929475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:34.960143 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1066/2124] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:34.963996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a12036-79b2-4091-96fe-12d8b477b8d7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:34.964306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a12036-79b2-4091-96fe-12d8b477b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:34.964622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a12036-79b2-4091-96fe-12d8b477b8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:34.983135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-50a12036-79b2-4091-96fe-12d8b477b8d7 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:34.984368 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-50a12036-79b2-4091-96fe-12d8b477b8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:34.992058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1067/2125] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:30:34.996379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a12036-79b2-4091-96fe-12d8b477b8d7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.000407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ea245-13c5-47e4-a43e-f068890e84ae admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.005151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a12036-79b2-4091-96fe-12d8b477b8d7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.005698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.006575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.006860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.007143 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] PATH_INFO: `/v3/projects/1be97ca7e5b84202990888c15eb8476d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.008380 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be97ca7e5b84202990888c15eb8476d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.009703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333e60d-67f1-4a9e-8a91-70d8802c9ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.010339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333e60d-67f1-4a9e-8a91-70d8802c9ede admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.010444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.010616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333e60d-67f1-4a9e-8a91-70d8802c9ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.010874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333e60d-67f1-4a9e-8a91-70d8802c9ede admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.011620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333e60d-67f1-4a9e-8a91-70d8802c9ede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:35.012036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333e60d-67f1-4a9e-8a91-70d8802c9ede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.013625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333e60d-67f1-4a9e-8a91-70d8802c9ede admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.025958 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1068/2126] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:30:35.029843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333e60d-67f1-4a9e-8a91-70d8802c9ede admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.040214 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333e60d-67f1-4a9e-8a91-70d8802c9ede admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.045403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52182e-9533-4c7c-9f7b-795f0229c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.046053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52182e-9533-4c7c-9f7b-795f0229c6ed admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.046332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52182e-9533-4c7c-9f7b-795f0229c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.046608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52182e-9533-4c7c-9f7b-795f0229c6ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.047299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52182e-9533-4c7c-9f7b-795f0229c6ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.049237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b52182e-9533-4c7c-9f7b-795f0229c6ed admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.059738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be97ca7e5b84202990888c15eb8476d', 'request_id': 'req-26855fcb-25cb-4a86-87e1-5cf891696564'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.065632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be97ca7e5b84202990888c15eb8476d', 'request_id': 'req-26855fcb-25cb-4a86-87e1-5cf891696564'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.072343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be97ca7e5b84202990888c15eb8476d', 'request_id': 'req-26855fcb-25cb-4a86-87e1-5cf891696564'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.078134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1069/2127] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:35 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:35.082618 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52182e-9533-4c7c-9f7b-795f0229c6ed admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.087247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] The token cache is being invalidate because project 1be97ca7e5b84202990888c15eb8476d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:35.087542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.088307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.090794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1059/2128] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:34 2022] DELETE /identity/v3/projects/1be97ca7e5b84202990888c15eb8476d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:35.092201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:35.094779 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.096561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:35.147302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52182e-9533-4c7c-9f7b-795f0229c6ed admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.151932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12cd52-ded9-46c8-a87a-f46184745b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.152731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12cd52-ded9-46c8-a87a-f46184745b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.153060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12cd52-ded9-46c8-a87a-f46184745b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.153299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12cd52-ded9-46c8-a87a-f46184745b8d admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.154049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12cd52-ded9-46c8-a87a-f46184745b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.155991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12cd52-ded9-46c8-a87a-f46184745b8d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.166032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855fcb-25cb-4a86-87e1-5cf891696564 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.171712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.172694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.173001 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.173363 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] PATH_INFO: `/v3/users/f7e21e67223243398fe6df208a65dacc` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.174670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e21e67223243398fe6df208a65dacc)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.176977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.177803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1070/2129] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:35 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:30:35.181630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12cd52-ded9-46c8-a87a-f46184745b8d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.183219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2c12cd52-ded9-46c8-a87a-f46184745b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:35.195633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12cd52-ded9-46c8-a87a-f46184745b8d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.201779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23299267-58e6-4b75-bfbb-e2d267d2ec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.202469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23299267-58e6-4b75-bfbb-e2d267d2ec37 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.202756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23299267-58e6-4b75-bfbb-e2d267d2ec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.203032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23299267-58e6-4b75-bfbb-e2d267d2ec37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.203766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23299267-58e6-4b75-bfbb-e2d267d2ec37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.205464 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23299267-58e6-4b75-bfbb-e2d267d2ec37 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.216650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1071/2130] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:35.220252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:35.220588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23299267-58e6-4b75-bfbb-e2d267d2ec37 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.226937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e21e67223243398fe6df208a65dacc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.230586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23299267-58e6-4b75-bfbb-e2d267d2ec37 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.235568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7f380-ab2b-4303-93ab-736aef49e294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.236254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f380-ab2b-4303-93ab-736aef49e294 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.236546 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f380-ab2b-4303-93ab-736aef49e294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.236826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f380-ab2b-4303-93ab-736aef49e294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.237550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7f380-ab2b-4303-93ab-736aef49e294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.239184 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7f380-ab2b-4303-93ab-736aef49e294 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.240410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e21e67223243398fe6df208a65dacc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.250476 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e21e67223243398fe6df208a65dacc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.251404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1072/2131] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:35.255768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7f380-ab2b-4303-93ab-736aef49e294 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.257802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e21e67223243398fe6df208a65dacc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.258472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-913c206a-ed64-49f7-9711-7ba3e9979426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e21e67223243398fe6df208a65dacc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.264667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1060/2132] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:35 2022] DELETE /identity/v3/users/f7e21e67223243398fe6df208a65dacc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:35.267693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7f380-ab2b-4303-93ab-736aef49e294 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.329050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aed18c-0844-49f1-a355-900ea239f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.329856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aed18c-0844-49f1-a355-900ea239f6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.330185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aed18c-0844-49f1-a355-900ea239f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.330495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aed18c-0844-49f1-a355-900ea239f6e6 admin admin] PATH_INFO: `/v3/projects/71dff5ee406141ec8e0d4a9b58106610/users/5b5a9f5cdfa6494d97617d68880d5552/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.346588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aed18c-0844-49f1-a355-900ea239f6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71dff5ee406141ec8e0d4a9b58106610, user_id=5b5a9f5cdfa6494d97617d68880d5552, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.349479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aed18c-0844-49f1-a355-900ea239f6e6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.364208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1073/2133] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:35 2022] PUT /identity/v3/projects/71dff5ee406141ec8e0d4a9b58106610/users/5b5a9f5cdfa6494d97617d68880d5552/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:35.369389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962c4be-054b-47bf-9ed2-3ca7bbb65d0e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.369680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962c4be-054b-47bf-9ed2-3ca7bbb65d0e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.369955 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962c4be-054b-47bf-9ed2-3ca7bbb65d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.387969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1962c4be-054b-47bf-9ed2-3ca7bbb65d0e None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:35.388938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1962c4be-054b-47bf-9ed2-3ca7bbb65d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:35.451708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1061/2134] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:35.461952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aed18c-0844-49f1-a355-900ea239f6e6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.463798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e4aed18c-0844-49f1-a355-900ea239f6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:35.524412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aed18c-0844-49f1-a355-900ea239f6e6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.528661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b01ec-1421-41b5-bdd0-80b7940aeaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.529457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b01ec-1421-41b5-bdd0-80b7940aeaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.529594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b01ec-1421-41b5-bdd0-80b7940aeaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.529926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b01ec-1421-41b5-bdd0-80b7940aeaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.542642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b01ec-1421-41b5-bdd0-80b7940aeaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.544654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b01ec-1421-41b5-bdd0-80b7940aeaf0 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.554297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962c4be-054b-47bf-9ed2-3ca7bbb65d0e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.555452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1074/2135] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:35.555723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1962c4be-054b-47bf-9ed2-3ca7bbb65d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:35.572719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962c4be-054b-47bf-9ed2-3ca7bbb65d0e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.579622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.580498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.580798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.581107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] PATH_INFO: `/v3/projects/2a0527b5912540a382cf43f6e36faaa9` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.582494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0527b5912540a382cf43f6e36faaa9)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.584895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.651125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0527b5912540a382cf43f6e36faaa9', 'request_id': 'req-b4655072-9d2c-48e7-a9f4-0352d16119b1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.660797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0527b5912540a382cf43f6e36faaa9', 'request_id': 'req-b4655072-9d2c-48e7-a9f4-0352d16119b1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.673123 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0527b5912540a382cf43f6e36faaa9', 'request_id': 'req-b4655072-9d2c-48e7-a9f4-0352d16119b1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.699931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] The token cache is being invalidate because project 2a0527b5912540a382cf43f6e36faaa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:35.700329 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.701071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b4655072-9d2c-48e7-a9f4-0352d16119b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:35.702684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1062/2136] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:35 2022] DELETE /identity/v3/projects/2a0527b5912540a382cf43f6e36faaa9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:35.708445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1938ec-20d8-4cda-b0c9-442795fea0e2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.708742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1938ec-20d8-4cda-b0c9-442795fea0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.709024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1938ec-20d8-4cda-b0c9-442795fea0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.717712 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:35.732683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ff1938ec-20d8-4cda-b0c9-442795fea0e2 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:35.733921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ff1938ec-20d8-4cda-b0c9-442795fea0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:35.823673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1075/2137] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:35.838207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8276090-5aed-40e7-ab6c-de0151df9fe5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.839232 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8276090-5aed-40e7-ab6c-de0151df9fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.839843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8276090-5aed-40e7-ab6c-de0151df9fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.859685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f8276090-5aed-40e7-ab6c-de0151df9fe5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:35.860932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f8276090-5aed-40e7-ab6c-de0151df9fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:35.869717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1063/2138] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:35.874127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1938ec-20d8-4cda-b0c9-442795fea0e2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.884889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1938ec-20d8-4cda-b0c9-442795fea0e2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.891017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21f461-c96b-4840-9a3d-fa7232f83bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.891713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f461-c96b-4840-9a3d-fa7232f83bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.892046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f461-c96b-4840-9a3d-fa7232f83bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.892313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f461-c96b-4840-9a3d-fa7232f83bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.893066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21f461-c96b-4840-9a3d-fa7232f83bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:35.893378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21f461-c96b-4840-9a3d-fa7232f83bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.895013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21f461-c96b-4840-9a3d-fa7232f83bd2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.911150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1076/2139] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:30:35.912974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8276090-5aed-40e7-ab6c-de0151df9fe5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.923849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8276090-5aed-40e7-ab6c-de0151df9fe5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:35.930283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbd0c-657a-49ba-b969-1cf2d48cdf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:35.931003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbd0c-657a-49ba-b969-1cf2d48cdf12 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:35.931291 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbd0c-657a-49ba-b969-1cf2d48cdf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:35.931569 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbbd0c-657a-49ba-b969-1cf2d48cdf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:35.932359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbbd0c-657a-49ba-b969-1cf2d48cdf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:35.934366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbbd0c-657a-49ba-b969-1cf2d48cdf12 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:35.966152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1064/2140] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:35 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:35.969976 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21f461-c96b-4840-9a3d-fa7232f83bd2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:35.981130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21f461-c96b-4840-9a3d-fa7232f83bd2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:36.052185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca409618-2905-40da-8f6c-98e6f5e11342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:36.053878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca409618-2905-40da-8f6c-98e6f5e11342 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.054693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca409618-2905-40da-8f6c-98e6f5e11342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.054978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca409618-2905-40da-8f6c-98e6f5e11342 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.055684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca409618-2905-40da-8f6c-98e6f5e11342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:36.057797 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca409618-2905-40da-8f6c-98e6f5e11342 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:36.079650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1077/2141] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:35 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:36.084345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbd0c-657a-49ba-b969-1cf2d48cdf12 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:36.095003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbbd0c-657a-49ba-b969-1cf2d48cdf12 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:36.105654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe96c13-6b5e-42bd-a092-c3c33099d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:36.106373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96c13-6b5e-42bd-a092-c3c33099d01f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.106653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96c13-6b5e-42bd-a092-c3c33099d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.106928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96c13-6b5e-42bd-a092-c3c33099d01f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.107670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe96c13-6b5e-42bd-a092-c3c33099d01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:36.109320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe96c13-6b5e-42bd-a092-c3c33099d01f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:36.115050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:36.121520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1065/2142] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:36.125827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca409618-2905-40da-8f6c-98e6f5e11342 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:36.137902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca409618-2905-40da-8f6c-98e6f5e11342 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:36.143319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2d43a-ad16-4377-b565-a52e7e529109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:36.144024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d43a-ad16-4377-b565-a52e7e529109 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.144326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d43a-ad16-4377-b565-a52e7e529109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.144730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d43a-ad16-4377-b565-a52e7e529109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.145468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2d43a-ad16-4377-b565-a52e7e529109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:36.147086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2d43a-ad16-4377-b565-a52e7e529109 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:36.160038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1078/2143] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:36.162175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe96c13-6b5e-42bd-a092-c3c33099d01f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:36.173126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe96c13-6b5e-42bd-a092-c3c33099d01f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:36.178816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff05fa-8846-4cd7-831d-67c4deba407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:36.179860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff05fa-8846-4cd7-831d-67c4deba407b admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.180431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff05fa-8846-4cd7-831d-67c4deba407b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.180572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff05fa-8846-4cd7-831d-67c4deba407b admin admin] PATH_INFO: `/v3/projects/ffc44cbdcab94faabac7d454f774de6a/users/7ede6fdeeb514735834f81fe0bc07a9c/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.195460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff05fa-8846-4cd7-831d-67c4deba407b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc44cbdcab94faabac7d454f774de6a, user_id=7ede6fdeeb514735834f81fe0bc07a9c, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:36.198179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff05fa-8846-4cd7-831d-67c4deba407b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:36.214834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1066/2144] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:36 2022] PUT /identity/v3/projects/ffc44cbdcab94faabac7d454f774de6a/users/7ede6fdeeb514735834f81fe0bc07a9c/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:36.226680 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c5fbd-b35c-421d-8f84-616d3b855f87 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.226981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c5fbd-b35c-421d-8f84-616d3b855f87 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.227234 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c5fbd-b35c-421d-8f84-616d3b855f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.255810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-076c5fbd-b35c-421d-8f84-616d3b855f87 None None] MFA Rules not processed for user `7ede6fdeeb514735834f81fe0bc07a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:36.257060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-076c5fbd-b35c-421d-8f84-616d3b855f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:36.337092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:36.343850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1079/2145] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:36.348399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff05fa-8846-4cd7-831d-67c4deba407b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:36.434762 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff05fa-8846-4cd7-831d-67c4deba407b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:36.439505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314db27b-aa83-4dc2-9d00-fbdbfac8b742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:36.440223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db27b-aa83-4dc2-9d00-fbdbfac8b742 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.440508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db27b-aa83-4dc2-9d00-fbdbfac8b742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.440784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314db27b-aa83-4dc2-9d00-fbdbfac8b742 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.441627 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314db27b-aa83-4dc2-9d00-fbdbfac8b742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:36.444035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314db27b-aa83-4dc2-9d00-fbdbfac8b742 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:36.471426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1067/2146] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:36 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:36.475402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c5fbd-b35c-421d-8f84-616d3b855f87 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:36.487144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c5fbd-b35c-421d-8f84-616d3b855f87 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:36.562169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b25b-cb55-43b1-a7ce-92d121dc3b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:36.562998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b25b-cb55-43b1-a7ce-92d121dc3b2c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.563402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b25b-cb55-43b1-a7ce-92d121dc3b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.563748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b25b-cb55-43b1-a7ce-92d121dc3b2c admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.564706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172b25b-cb55-43b1-a7ce-92d121dc3b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:36.566775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172b25b-cb55-43b1-a7ce-92d121dc3b2c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:36.592326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1080/2147] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:36 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:36.596178 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314db27b-aa83-4dc2-9d00-fbdbfac8b742 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:36.608395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314db27b-aa83-4dc2-9d00-fbdbfac8b742 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:36.615668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf163d4-e910-4404-bbc1-cc541c53413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:36.616360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf163d4-e910-4404-bbc1-cc541c53413e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.616744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf163d4-e910-4404-bbc1-cc541c53413e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.617119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf163d4-e910-4404-bbc1-cc541c53413e admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.618138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf163d4-e910-4404-bbc1-cc541c53413e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:36.619744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf163d4-e910-4404-bbc1-cc541c53413e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:36.636607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1068/2148] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:36.640025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b25b-cb55-43b1-a7ce-92d121dc3b2c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:36.650853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b25b-cb55-43b1-a7ce-92d121dc3b2c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:36.657296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e94e0b-4421-4466-9c00-707decdec822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:36.658207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e94e0b-4421-4466-9c00-707decdec822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.658485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e94e0b-4421-4466-9c00-707decdec822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.658756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e94e0b-4421-4466-9c00-707decdec822 admin admin] PATH_INFO: `/v3/projects/6e5316f9cb974c539f7a66c0c3ece89e/users/d549a683be8b4981b2d4610885582667/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.678077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e94e0b-4421-4466-9c00-707decdec822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5316f9cb974c539f7a66c0c3ece89e, user_id=d549a683be8b4981b2d4610885582667, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:36.681896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e94e0b-4421-4466-9c00-707decdec822 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:36.703785 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1081/2149] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:36 2022] PUT /identity/v3/projects/6e5316f9cb974c539f7a66c0c3ece89e/users/d549a683be8b4981b2d4610885582667/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:36.708108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf163d4-e910-4404-bbc1-cc541c53413e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:36.723349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf163d4-e910-4404-bbc1-cc541c53413e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:36.801141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82821964-d5d4-4422-bb9b-d390f9bb4b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:36.802328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82821964-d5d4-4422-bb9b-d390f9bb4b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.803148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82821964-d5d4-4422-bb9b-d390f9bb4b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.803763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82821964-d5d4-4422-bb9b-d390f9bb4b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.804904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82821964-d5d4-4422-bb9b-d390f9bb4b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:36.807447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82821964-d5d4-4422-bb9b-d390f9bb4b1d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:36.821385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1069/2150] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:36.825970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e94e0b-4421-4466-9c00-707decdec822 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:36.853405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e94e0b-4421-4466-9c00-707decdec822 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:36.860541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5f31f-0818-4833-a108-703464d06e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:36.861707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5f31f-0818-4833-a108-703464d06e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.861995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5f31f-0818-4833-a108-703464d06e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.862273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5f31f-0818-4833-a108-703464d06e73 admin admin] PATH_INFO: `/v3/projects/6e5316f9cb974c539f7a66c0c3ece89e/users/d549a683be8b4981b2d4610885582667/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.864870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5f31f-0818-4833-a108-703464d06e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5316f9cb974c539f7a66c0c3ece89e, user_id=d549a683be8b4981b2d4610885582667, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:36.867985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5f31f-0818-4833-a108-703464d06e73 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:36.886013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1082/2151] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:36 2022] PUT /identity/v3/projects/6e5316f9cb974c539f7a66c0c3ece89e/users/d549a683be8b4981b2d4610885582667/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:36.905989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c763b-d321-4250-9842-47c80e24063c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:36.906422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c763b-d321-4250-9842-47c80e24063c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:36.906799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c763b-d321-4250-9842-47c80e24063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:36.945571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-208c763b-d321-4250-9842-47c80e24063c None None] MFA Rules not processed for user `d549a683be8b4981b2d4610885582667`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:36.947182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-208c763b-d321-4250-9842-47c80e24063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:36.999204 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:37.054722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1070/2152] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:37.063438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5f31f-0818-4833-a108-703464d06e73 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:37.065745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2bd5f31f-0818-4833-a108-703464d06e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:37.200189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5f31f-0818-4833-a108-703464d06e73 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:37.204838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab211f9e-05c9-42de-8e6c-0632360d3980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:37.205532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab211f9e-05c9-42de-8e6c-0632360d3980 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:37.205814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab211f9e-05c9-42de-8e6c-0632360d3980 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:37.206088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab211f9e-05c9-42de-8e6c-0632360d3980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:37.216361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab211f9e-05c9-42de-8e6c-0632360d3980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:37.217822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab211f9e-05c9-42de-8e6c-0632360d3980 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:37.229728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1083/2153] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:37.695936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c763b-d321-4250-9842-47c80e24063c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:37.769773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c763b-d321-4250-9842-47c80e24063c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:37.774293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:37.775191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:37.775471 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:37.775742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] PATH_INFO: `/v3/users/7ede6fdeeb514735834f81fe0bc07a9c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:37.776950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ede6fdeeb514735834f81fe0bc07a9c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:37.778938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:37.832206 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ede6fdeeb514735834f81fe0bc07a9c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:37.847159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ede6fdeeb514735834f81fe0bc07a9c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:37.857445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ede6fdeeb514735834f81fe0bc07a9c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:37.869967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ede6fdeeb514735834f81fe0bc07a9c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:37.870885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ede6fdeeb514735834f81fe0bc07a9c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:37.878098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1071/2154] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:37 2022] DELETE /identity/v3/users/7ede6fdeeb514735834f81fe0bc07a9c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:37.882569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808162e-54f5-46f1-b0a6-976b25a42093 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:37.883056 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808162e-54f5-46f1-b0a6-976b25a42093 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:37.883198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808162e-54f5-46f1-b0a6-976b25a42093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:37.902764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d808162e-54f5-46f1-b0a6-976b25a42093 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:37.904690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d808162e-54f5-46f1-b0a6-976b25a42093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:37.963961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:37.986090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1084/2155] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:37.993194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:37.994848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:38.071478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab9fce-bf6c-4fea-8a3b-927281268a2d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:38.075790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28a7b8-8fae-431d-931b-0c8d2eddfd2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:38.076491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28a7b8-8fae-431d-931b-0c8d2eddfd2a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:38.076785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28a7b8-8fae-431d-931b-0c8d2eddfd2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:38.077045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28a7b8-8fae-431d-931b-0c8d2eddfd2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:38.084400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:38.089709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28a7b8-8fae-431d-931b-0c8d2eddfd2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:38.092522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28a7b8-8fae-431d-931b-0c8d2eddfd2a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:38.111885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1072/2156] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:30:38.542930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808162e-54f5-46f1-b0a6-976b25a42093 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:38.548083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d808162e-54f5-46f1-b0a6-976b25a42093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:38.593739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808162e-54f5-46f1-b0a6-976b25a42093 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:38.608614 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:38.609636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:38.610000 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:38.610373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] PATH_INFO: `/v3/projects/ffc44cbdcab94faabac7d454f774de6a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:38.612396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc44cbdcab94faabac7d454f774de6a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:38.614385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:38.719978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc44cbdcab94faabac7d454f774de6a', 'request_id': 'req-f9e5e528-223c-4fab-bc04-c6ac7d97d801'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:38.733576 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc44cbdcab94faabac7d454f774de6a', 'request_id': 'req-f9e5e528-223c-4fab-bc04-c6ac7d97d801'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:38.744626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc44cbdcab94faabac7d454f774de6a', 'request_id': 'req-f9e5e528-223c-4fab-bc04-c6ac7d97d801'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:38.758944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] The token cache is being invalidate because project ffc44cbdcab94faabac7d454f774de6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:38.759325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:38.760247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:38.762701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1085/2157] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:38 2022] DELETE /identity/v3/projects/ffc44cbdcab94faabac7d454f774de6a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:38.766562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28a7b8-8fae-431d-931b-0c8d2eddfd2a service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:38.785318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28a7b8-8fae-431d-931b-0c8d2eddfd2a service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:38.855633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:38.857530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:38.857999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:38.858383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] PATH_INFO: `/v3/users/d549a683be8b4981b2d4610885582667` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:38.860286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d549a683be8b4981b2d4610885582667)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:38.862695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:38.929792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd549a683be8b4981b2d4610885582667'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:38.947533 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd549a683be8b4981b2d4610885582667'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:38.966069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd549a683be8b4981b2d4610885582667'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:38.974257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd549a683be8b4981b2d4610885582667'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:38.975174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7dc9c8c6-9ae9-426a-9bec-d477f3e49a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd549a683be8b4981b2d4610885582667'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:38.982493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1073/2158] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:38 2022] DELETE /identity/v3/users/d549a683be8b4981b2d4610885582667 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:39.727201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:39.732973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:39.770714 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e528-223c-4fab-bc04-c6ac7d97d801 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:39.885171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:39.886108 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:39.886381 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:39.886709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] PATH_INFO: `/v3/projects/6e5316f9cb974c539f7a66c0c3ece89e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:39.887896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5316f9cb974c539f7a66c0c3ece89e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:39.889904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:39.946520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5316f9cb974c539f7a66c0c3ece89e', 'request_id': 'req-c69cca4a-96f8-40e3-8539-7be424cf00f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:39.956977 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5316f9cb974c539f7a66c0c3ece89e', 'request_id': 'req-c69cca4a-96f8-40e3-8539-7be424cf00f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:39.964299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5316f9cb974c539f7a66c0c3ece89e', 'request_id': 'req-c69cca4a-96f8-40e3-8539-7be424cf00f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:39.980958 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] The token cache is being invalidate because project 6e5316f9cb974c539f7a66c0c3ece89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:39.981406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:39.982122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c69cca4a-96f8-40e3-8539-7be424cf00f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:39.983796 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1086/2159] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:39 2022] DELETE /identity/v3/projects/6e5316f9cb974c539f7a66c0c3ece89e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:39.988739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd49aa9-9e83-4c2e-be65-76bb81ae7b92 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:39.989180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd49aa9-9e83-4c2e-be65-76bb81ae7b92 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:39.989324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd49aa9-9e83-4c2e-be65-76bb81ae7b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.009282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6cd49aa9-9e83-4c2e-be65-76bb81ae7b92 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:40.010509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6cd49aa9-9e83-4c2e-be65-76bb81ae7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:40.088264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1074/2160] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:30:40.091891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f2c0b-2150-4fa9-b38b-017eb30ef5b1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:40.092511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f2c0b-2150-4fa9-b38b-017eb30ef5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:40.092973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f2c0b-2150-4fa9-b38b-017eb30ef5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.120512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:40.130713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c64f2c0b-2150-4fa9-b38b-017eb30ef5b1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:40.159880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c64f2c0b-2150-4fa9-b38b-017eb30ef5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:40.181639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1087/2161] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:40.182983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd49aa9-9e83-4c2e-be65-76bb81ae7b92 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:40.202902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd49aa9-9e83-4c2e-be65-76bb81ae7b92 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:40.209184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338a67d-b43f-44e4-bb7b-0dfd7923f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:40.209868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338a67d-b43f-44e4-bb7b-0dfd7923f3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:40.210148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338a67d-b43f-44e4-bb7b-0dfd7923f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:40.210426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338a67d-b43f-44e4-bb7b-0dfd7923f3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.211166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338a67d-b43f-44e4-bb7b-0dfd7923f3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:40.212157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338a67d-b43f-44e4-bb7b-0dfd7923f3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:40.213811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338a67d-b43f-44e4-bb7b-0dfd7923f3c7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:40.223474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:40.232894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1075/2162] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:30:40.233149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f2c0b-2150-4fa9-b38b-017eb30ef5b1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:40.243032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f2c0b-2150-4fa9-b38b-017eb30ef5b1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:40.249642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22dcb6-4648-4f90-ae7d-3bc31e25593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:40.250330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22dcb6-4648-4f90-ae7d-3bc31e25593c admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:40.250611 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22dcb6-4648-4f90-ae7d-3bc31e25593c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:40.250927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22dcb6-4648-4f90-ae7d-3bc31e25593c admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.251599 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22dcb6-4648-4f90-ae7d-3bc31e25593c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:40.253938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22dcb6-4648-4f90-ae7d-3bc31e25593c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:40.292364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1088/2163] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:40 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:40.294669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338a67d-b43f-44e4-bb7b-0dfd7923f3c7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:40.312286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338a67d-b43f-44e4-bb7b-0dfd7923f3c7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:40.400140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79d1f6-ca3d-448c-b26b-b48441bdb857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:40.400881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79d1f6-ca3d-448c-b26b-b48441bdb857 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:40.401172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79d1f6-ca3d-448c-b26b-b48441bdb857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:40.401452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79d1f6-ca3d-448c-b26b-b48441bdb857 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.402419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79d1f6-ca3d-448c-b26b-b48441bdb857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:40.404516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79d1f6-ca3d-448c-b26b-b48441bdb857 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:40.434400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1076/2164] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:40 2022] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:40.435641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22dcb6-4648-4f90-ae7d-3bc31e25593c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:40.449203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22dcb6-4648-4f90-ae7d-3bc31e25593c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:40.455504 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d8081-4fc0-492e-baeb-24f2c91b600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:40.456391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d8081-4fc0-492e-baeb-24f2c91b600c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:40.456678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d8081-4fc0-492e-baeb-24f2c91b600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:40.457009 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d8081-4fc0-492e-baeb-24f2c91b600c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.458016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d8081-4fc0-492e-baeb-24f2c91b600c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:40.460252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d8081-4fc0-492e-baeb-24f2c91b600c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:40.481475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1089/2165] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:40.486327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79d1f6-ca3d-448c-b26b-b48441bdb857 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:40.500145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79d1f6-ca3d-448c-b26b-b48441bdb857 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:40.505325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b84287-bab8-4620-9a10-e20843c3c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:40.506025 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b84287-bab8-4620-9a10-e20843c3c3cb admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:40.506306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b84287-bab8-4620-9a10-e20843c3c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:40.506738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b84287-bab8-4620-9a10-e20843c3c3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.507694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b84287-bab8-4620-9a10-e20843c3c3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:40.509762 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b84287-bab8-4620-9a10-e20843c3c3cb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:40.526394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1077/2166] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:40.527260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d8081-4fc0-492e-baeb-24f2c91b600c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:40.540954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d8081-4fc0-492e-baeb-24f2c91b600c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:40.546724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a01d0f-43db-4d88-bd1f-1eb0c595d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:40.547810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01d0f-43db-4d88-bd1f-1eb0c595d439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:40.548801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01d0f-43db-4d88-bd1f-1eb0c595d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:40.549149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01d0f-43db-4d88-bd1f-1eb0c595d439 admin admin] PATH_INFO: `/v3/projects/0c88de51778c480298c61f28237de75e/users/4077cd70a3994e49bfa0fce585e5cbb5/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.570171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a01d0f-43db-4d88-bd1f-1eb0c595d439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c88de51778c480298c61f28237de75e, user_id=4077cd70a3994e49bfa0fce585e5cbb5, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:40.574422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a01d0f-43db-4d88-bd1f-1eb0c595d439 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:40.597210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1090/2167] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:40 2022] PUT /identity/v3/projects/0c88de51778c480298c61f28237de75e/users/4077cd70a3994e49bfa0fce585e5cbb5/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:40.609791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2894-33f0-439a-81f9-4203e5a57eec None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:40.610081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2894-33f0-439a-81f9-4203e5a57eec None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:40.610367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2894-33f0-439a-81f9-4203e5a57eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.647625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fbbc2894-33f0-439a-81f9-4203e5a57eec None None] MFA Rules not processed for user `4077cd70a3994e49bfa0fce585e5cbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:40.649389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fbbc2894-33f0-439a-81f9-4203e5a57eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:40.669703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668399bc-4d5d-4eb2-b5d4-c90f117fb1b2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:40.670072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668399bc-4d5d-4eb2-b5d4-c90f117fb1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:40.670372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668399bc-4d5d-4eb2-b5d4-c90f117fb1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.705229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-668399bc-4d5d-4eb2-b5d4-c90f117fb1b2 None None] MFA Rules not processed for user `5b5a9f5cdfa6494d97617d68880d5552`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:40.707305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-668399bc-4d5d-4eb2-b5d4-c90f117fb1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:40.734037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1078/2168] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:40.738635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2894-33f0-439a-81f9-4203e5a57eec None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:40.788053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1091/2169] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:40.797237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668399bc-4d5d-4eb2-b5d4-c90f117fb1b2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:40.798802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-668399bc-4d5d-4eb2-b5d4-c90f117fb1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:40.827061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2894-33f0-439a-81f9-4203e5a57eec None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:40.846863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d363746-3633-4b2d-a2b3-6b4575ccafa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:40.847656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d363746-3633-4b2d-a2b3-6b4575ccafa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:40.848040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d363746-3633-4b2d-a2b3-6b4575ccafa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:40.848391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d363746-3633-4b2d-a2b3-6b4575ccafa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:40.849176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d363746-3633-4b2d-a2b3-6b4575ccafa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:40.851512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d363746-3633-4b2d-a2b3-6b4575ccafa2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:40.875890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:40.908116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1079/2170] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:40 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:30:40.910271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d363746-3633-4b2d-a2b3-6b4575ccafa2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:40.924784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668399bc-4d5d-4eb2-b5d4-c90f117fb1b2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:41.023333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:41.027812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d363746-3633-4b2d-a2b3-6b4575ccafa2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:41.034152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10695180-026d-4cdd-b939-45a78bd61c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:41.034954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10695180-026d-4cdd-b939-45a78bd61c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:41.035879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10695180-026d-4cdd-b939-45a78bd61c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:41.035879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10695180-026d-4cdd-b939-45a78bd61c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:41.037152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10695180-026d-4cdd-b939-45a78bd61c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:41.040126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10695180-026d-4cdd-b939-45a78bd61c4d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:41.074939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1080/2171] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:40 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:41.078428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10695180-026d-4cdd-b939-45a78bd61c4d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:41.085772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d30bba-5cd6-466e-9b54-a9b5f13a9542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:41.086890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d30bba-5cd6-466e-9b54-a9b5f13a9542 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:41.087431 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d30bba-5cd6-466e-9b54-a9b5f13a9542 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:41.087933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d30bba-5cd6-466e-9b54-a9b5f13a9542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:41.089194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10695180-026d-4cdd-b939-45a78bd61c4d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:41.094681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f960f-5172-4d86-a0fd-db0229216212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:41.095364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f960f-5172-4d86-a0fd-db0229216212 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:41.095652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f960f-5172-4d86-a0fd-db0229216212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:41.095931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f960f-5172-4d86-a0fd-db0229216212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:41.096736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f960f-5172-4d86-a0fd-db0229216212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:41.098369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f960f-5172-4d86-a0fd-db0229216212 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:41.112063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1081/2172] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:41.113744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f960f-5172-4d86-a0fd-db0229216212 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:41.125328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f960f-5172-4d86-a0fd-db0229216212 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:41.133154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade094ea-29de-4135-b8a1-cc85152bd674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:41.134720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade094ea-29de-4135-b8a1-cc85152bd674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:41.135049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade094ea-29de-4135-b8a1-cc85152bd674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:41.135326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade094ea-29de-4135-b8a1-cc85152bd674 admin admin] PATH_INFO: `/v3/projects/de9d0a95847e42de8684c36c34ec0965/users/42f7d3dbf2314adf8ca08eadc8fef1f7/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:41.156719 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade094ea-29de-4135-b8a1-cc85152bd674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9d0a95847e42de8684c36c34ec0965, user_id=42f7d3dbf2314adf8ca08eadc8fef1f7, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:41.158118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d30bba-5cd6-466e-9b54-a9b5f13a9542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:41.159439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade094ea-29de-4135-b8a1-cc85152bd674 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:41.159753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d30bba-5cd6-466e-9b54-a9b5f13a9542 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:41.174374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1092/2173] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:41.194109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1082/2174] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:41 2022] PUT /identity/v3/projects/de9d0a95847e42de8684c36c34ec0965/users/42f7d3dbf2314adf8ca08eadc8fef1f7/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:41.197886 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d30bba-5cd6-466e-9b54-a9b5f13a9542 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:41.215430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d30bba-5cd6-466e-9b54-a9b5f13a9542 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:41.348747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49403dd-73f6-45eb-97ff-2b799e36731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:41.349793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49403dd-73f6-45eb-97ff-2b799e36731e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:41.350083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49403dd-73f6-45eb-97ff-2b799e36731e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:41.350361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49403dd-73f6-45eb-97ff-2b799e36731e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:41.351413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49403dd-73f6-45eb-97ff-2b799e36731e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:41.353257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49403dd-73f6-45eb-97ff-2b799e36731e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:41.369347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1093/2175] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:41.373909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade094ea-29de-4135-b8a1-cc85152bd674 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:41.384772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade094ea-29de-4135-b8a1-cc85152bd674 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:41.391387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166a93a-56c3-4aee-a4f1-74ac4fb62c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:41.392476 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166a93a-56c3-4aee-a4f1-74ac4fb62c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:41.393122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166a93a-56c3-4aee-a4f1-74ac4fb62c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:41.393816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166a93a-56c3-4aee-a4f1-74ac4fb62c20 admin admin] PATH_INFO: `/v3/projects/de9d0a95847e42de8684c36c34ec0965/users/42f7d3dbf2314adf8ca08eadc8fef1f7/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:41.396309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166a93a-56c3-4aee-a4f1-74ac4fb62c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9d0a95847e42de8684c36c34ec0965, user_id=42f7d3dbf2314adf8ca08eadc8fef1f7, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:41.400037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166a93a-56c3-4aee-a4f1-74ac4fb62c20 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:41.414911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1083/2176] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:41 2022] PUT /identity/v3/projects/de9d0a95847e42de8684c36c34ec0965/users/42f7d3dbf2314adf8ca08eadc8fef1f7/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:41.427120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fdfb6-f20b-4c46-808b-4e871a628e44 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:41.427597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fdfb6-f20b-4c46-808b-4e871a628e44 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:41.427909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fdfb6-f20b-4c46-808b-4e871a628e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:41.462592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-972fdfb6-f20b-4c46-808b-4e871a628e44 None None] MFA Rules not processed for user `42f7d3dbf2314adf8ca08eadc8fef1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:41.466347 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-972fdfb6-f20b-4c46-808b-4e871a628e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:41.545599 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:41.571388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1094/2177] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:41.588790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166a93a-56c3-4aee-a4f1-74ac4fb62c20 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:41.593781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2166a93a-56c3-4aee-a4f1-74ac4fb62c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:41.691517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166a93a-56c3-4aee-a4f1-74ac4fb62c20 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:41.696453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fb597-3d39-4465-9a44-098097e303eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:41.697180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fb597-3d39-4465-9a44-098097e303eb service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:41.697467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fb597-3d39-4465-9a44-098097e303eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:41.697800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fb597-3d39-4465-9a44-098097e303eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:41.710157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fb597-3d39-4465-9a44-098097e303eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:41.711873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fb597-3d39-4465-9a44-098097e303eb service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:41.722622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1084/2178] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:42.189491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fdfb6-f20b-4c46-808b-4e871a628e44 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:42.281728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fdfb6-f20b-4c46-808b-4e871a628e44 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:42.292442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:42.297248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:42.297761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:42.298220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] PATH_INFO: `/v3/users/4077cd70a3994e49bfa0fce585e5cbb5` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:42.299903 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4077cd70a3994e49bfa0fce585e5cbb5)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:42.305112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:42.392614 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4077cd70a3994e49bfa0fce585e5cbb5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:42.393358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4077cd70a3994e49bfa0fce585e5cbb5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:42.423613 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4077cd70a3994e49bfa0fce585e5cbb5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:42.424410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4077cd70a3994e49bfa0fce585e5cbb5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:42.433758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4077cd70a3994e49bfa0fce585e5cbb5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:42.460377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1095/2179] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:42 2022] DELETE /identity/v3/users/4077cd70a3994e49bfa0fce585e5cbb5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:42.465746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3953e2-e929-44bc-9be6-38906c7b14a1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:42.466780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3953e2-e929-44bc-9be6-38906c7b14a1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:42.467238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3953e2-e929-44bc-9be6-38906c7b14a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:42.490908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-aa3953e2-e929-44bc-9be6-38906c7b14a1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:42.492689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-aa3953e2-e929-44bc-9be6-38906c7b14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:42.549662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:42.594020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1085/2180] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:42.604697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:42.608809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:42.716633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa1255-2ad7-45e1-842c-e05412e2d190 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:42.723666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60583bc5-ac97-4041-b66a-47c7c8dc9b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:42.724468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60583bc5-ac97-4041-b66a-47c7c8dc9b15 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:42.724783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60583bc5-ac97-4041-b66a-47c7c8dc9b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:42.725032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60583bc5-ac97-4041-b66a-47c7c8dc9b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:42.736458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60583bc5-ac97-4041-b66a-47c7c8dc9b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:42.737835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60583bc5-ac97-4041-b66a-47c7c8dc9b15 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:42.754040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1096/2181] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:43.141752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72263849-8843-403a-af3b-e7819535c5a4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:43.142262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72263849-8843-403a-af3b-e7819535c5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:43.142668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72263849-8843-403a-af3b-e7819535c5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:43.172812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-72263849-8843-403a-af3b-e7819535c5a4 None None] MFA Rules not processed for user `5b5a9f5cdfa6494d97617d68880d5552`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:43.174171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-72263849-8843-403a-af3b-e7819535c5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:43.213469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60583bc5-ac97-4041-b66a-47c7c8dc9b15 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:43.216312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-60583bc5-ac97-4041-b66a-47c7c8dc9b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:43.240281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60583bc5-ac97-4041-b66a-47c7c8dc9b15 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:43.251664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:43.252737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:43.252891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:43.253167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] PATH_INFO: `/v3/projects/0c88de51778c480298c61f28237de75e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:43.254427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c88de51778c480298c61f28237de75e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:43.257060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:43.265986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:43.284144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1086/2182] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:43.352266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c88de51778c480298c61f28237de75e', 'request_id': 'req-cf4383d6-6e61-4b9e-984a-c60888a82123'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:43.370215 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c88de51778c480298c61f28237de75e', 'request_id': 'req-cf4383d6-6e61-4b9e-984a-c60888a82123'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:43.379899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c88de51778c480298c61f28237de75e', 'request_id': 'req-cf4383d6-6e61-4b9e-984a-c60888a82123'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:43.403036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] The token cache is being invalidate because project 0c88de51778c480298c61f28237de75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:43.403597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:43.404419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:43.408052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1097/2183] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:43 2022] DELETE /identity/v3/projects/0c88de51778c480298c61f28237de75e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:43.413323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72263849-8843-403a-af3b-e7819535c5a4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:43.426051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72263849-8843-403a-af3b-e7819535c5a4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:43.519303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:43.520254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:43.520545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:43.521208 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] PATH_INFO: `/v3/users/42f7d3dbf2314adf8ca08eadc8fef1f7` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:43.523053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f7d3dbf2314adf8ca08eadc8fef1f7)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:43.525278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:43.586645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f7d3dbf2314adf8ca08eadc8fef1f7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:43.601689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f7d3dbf2314adf8ca08eadc8fef1f7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:43.612661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f7d3dbf2314adf8ca08eadc8fef1f7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:43.628651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f7d3dbf2314adf8ca08eadc8fef1f7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:43.629504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-86eea956-106d-455a-9ab4-1d804923d4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f7d3dbf2314adf8ca08eadc8fef1f7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:43.637051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1087/2184] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:43 2022] DELETE /identity/v3/users/42f7d3dbf2314adf8ca08eadc8fef1f7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:44.209116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:44.211077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:44.240297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4383d6-6e61-4b9e-984a-c60888a82123 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:44.365578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:44.366867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:44.367208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:44.367494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] PATH_INFO: `/v3/projects/de9d0a95847e42de8684c36c34ec0965` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:44.369001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9d0a95847e42de8684c36c34ec0965)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:44.373747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:44.449395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9d0a95847e42de8684c36c34ec0965', 'request_id': 'req-05025ec3-8d6e-4813-8d0f-e4640ddd9419'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:44.463236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9d0a95847e42de8684c36c34ec0965', 'request_id': 'req-05025ec3-8d6e-4813-8d0f-e4640ddd9419'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:44.472350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9d0a95847e42de8684c36c34ec0965', 'request_id': 'req-05025ec3-8d6e-4813-8d0f-e4640ddd9419'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:44.485726 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] The token cache is being invalidate because project de9d0a95847e42de8684c36c34ec0965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:44.486083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:44.486777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-05025ec3-8d6e-4813-8d0f-e4640ddd9419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:44.492704 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1098/2185] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:44 2022] DELETE /identity/v3/projects/de9d0a95847e42de8684c36c34ec0965 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:44.494912 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04c788-01b5-49d5-ac63-16c0c93e51c8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:44.495209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04c788-01b5-49d5-ac63-16c0c93e51c8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:44.495583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04c788-01b5-49d5-ac63-16c0c93e51c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:44.506648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:44.523136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ac04c788-01b5-49d5-ac63-16c0c93e51c8 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:44.524558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ac04c788-01b5-49d5-ac63-16c0c93e51c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:44.624972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1088/2186] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:44.634133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0bd28-f1fe-4f4f-af75-4d85df8072e9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:44.634707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0bd28-f1fe-4f4f-af75-4d85df8072e9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:44.635130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0bd28-f1fe-4f4f-af75-4d85df8072e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:44.674310 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-86e0bd28-f1fe-4f4f-af75-4d85df8072e9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:44.676240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-86e0bd28-f1fe-4f4f-af75-4d85df8072e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:44.700457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1099/2187] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:44.701741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04c788-01b5-49d5-ac63-16c0c93e51c8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:44.718651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04c788-01b5-49d5-ac63-16c0c93e51c8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:44.725410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465930-98c9-4079-9974-a4f887c713a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:44.726217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465930-98c9-4079-9974-a4f887c713a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:44.726488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465930-98c9-4079-9974-a4f887c713a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:44.728194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465930-98c9-4079-9974-a4f887c713a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:44.729320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69465930-98c9-4079-9974-a4f887c713a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:44.729934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69465930-98c9-4079-9974-a4f887c713a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:44.732250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69465930-98c9-4079-9974-a4f887c713a9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:44.747954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1089/2188] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:30:44.753120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0bd28-f1fe-4f4f-af75-4d85df8072e9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:44.770595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0bd28-f1fe-4f4f-af75-4d85df8072e9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:44.785735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3dc6e-8ce5-42ee-bcbd-5504fe9763e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:44.786768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3dc6e-8ce5-42ee-bcbd-5504fe9763e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:44.787208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3dc6e-8ce5-42ee-bcbd-5504fe9763e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:44.788078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3dc6e-8ce5-42ee-bcbd-5504fe9763e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:44.789657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3dc6e-8ce5-42ee-bcbd-5504fe9763e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:44.793024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3dc6e-8ce5-42ee-bcbd-5504fe9763e7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:44.812683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:44.830932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1100/2189] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:44 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:44.835411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465930-98c9-4079-9974-a4f887c713a9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:44.847977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465930-98c9-4079-9974-a4f887c713a9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:44.913469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff42ad5-2257-4cb4-b538-cffcfb234e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:44.914499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42ad5-2257-4cb4-b538-cffcfb234e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:44.914784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42ad5-2257-4cb4-b538-cffcfb234e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:44.915060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff42ad5-2257-4cb4-b538-cffcfb234e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:44.915789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff42ad5-2257-4cb4-b538-cffcfb234e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:44.917894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff42ad5-2257-4cb4-b538-cffcfb234e50 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:44.939841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1090/2190] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:44 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:44.943832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3dc6e-8ce5-42ee-bcbd-5504fe9763e7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:44.955609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3dc6e-8ce5-42ee-bcbd-5504fe9763e7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:44.960437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a4225-453a-40a8-a7f6-cba4ee9e192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:44.961118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a4225-453a-40a8-a7f6-cba4ee9e192d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:44.961450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a4225-453a-40a8-a7f6-cba4ee9e192d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:44.961737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a4225-453a-40a8-a7f6-cba4ee9e192d admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:44.962543 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a4225-453a-40a8-a7f6-cba4ee9e192d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:44.964239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a4225-453a-40a8-a7f6-cba4ee9e192d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:44.980433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1101/2191] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:44.984601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff42ad5-2257-4cb4-b538-cffcfb234e50 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:44.997080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff42ad5-2257-4cb4-b538-cffcfb234e50 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.003271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a4225-453a-40a8-a7f6-cba4ee9e192d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:45.005201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9a9a4225-453a-40a8-a7f6-cba4ee9e192d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:45.006759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eea6ee-ee22-4304-adaf-e2d7a723794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.008140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea6ee-ee22-4304-adaf-e2d7a723794b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.008433 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea6ee-ee22-4304-adaf-e2d7a723794b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.008705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea6ee-ee22-4304-adaf-e2d7a723794b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.009463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eea6ee-ee22-4304-adaf-e2d7a723794b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.011118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eea6ee-ee22-4304-adaf-e2d7a723794b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:45.023911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1091/2192] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:45.024154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a4225-453a-40a8-a7f6-cba4ee9e192d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.026492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eea6ee-ee22-4304-adaf-e2d7a723794b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:45.033183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.036061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.036379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.037400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] PATH_INFO: `/v3/users/418619ee6c5b4cde8bbbaf5fd9ac01d4` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.040074 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=418619ee6c5b4cde8bbbaf5fd9ac01d4)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.041396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eea6ee-ee22-4304-adaf-e2d7a723794b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.042558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:45.048372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397e5e7-3031-4dc9-96c3-144c966cc4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.049368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397e5e7-3031-4dc9-96c3-144c966cc4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.049743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397e5e7-3031-4dc9-96c3-144c966cc4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.050075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397e5e7-3031-4dc9-96c3-144c966cc4a5 admin admin] PATH_INFO: `/v3/projects/1807ecf2ac8a417cb00cd19a50274253/users/75bf6892d91347328dedb56ecb36c1ad/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.073982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397e5e7-3031-4dc9-96c3-144c966cc4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1807ecf2ac8a417cb00cd19a50274253, user_id=75bf6892d91347328dedb56ecb36c1ad, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.077534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397e5e7-3031-4dc9-96c3-144c966cc4a5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:45.095661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1092/2193] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:45 2022] PUT /identity/v3/projects/1807ecf2ac8a417cb00cd19a50274253/users/75bf6892d91347328dedb56ecb36c1ad/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:45.107107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9a046-b8af-4a82-84e8-5344d9cd507b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.107388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9a046-b8af-4a82-84e8-5344d9cd507b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.107662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9a046-b8af-4a82-84e8-5344d9cd507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.125107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418619ee6c5b4cde8bbbaf5fd9ac01d4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:45.126080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418619ee6c5b4cde8bbbaf5fd9ac01d4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:45.136311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-81f9a046-b8af-4a82-84e8-5344d9cd507b None None] MFA Rules not processed for user `75bf6892d91347328dedb56ecb36c1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:45.137761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-81f9a046-b8af-4a82-84e8-5344d9cd507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:45.150319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418619ee6c5b4cde8bbbaf5fd9ac01d4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:45.151417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418619ee6c5b4cde8bbbaf5fd9ac01d4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:45.165812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1058984d-ef41-4e45-8edf-474070be2bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418619ee6c5b4cde8bbbaf5fd9ac01d4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:45.183180 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:45.186968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1102/2194] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:45 2022] DELETE /identity/v3/users/418619ee6c5b4cde8bbbaf5fd9ac01d4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:45.188950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20faefaf-60e1-4294-ae90-88fcc8027e11 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.189376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20faefaf-60e1-4294-ae90-88fcc8027e11 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.189748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20faefaf-60e1-4294-ae90-88fcc8027e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.212841 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-20faefaf-60e1-4294-ae90-88fcc8027e11 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:45.215238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-20faefaf-60e1-4294-ae90-88fcc8027e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:45.234732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1093/2195] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:45.239140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9a046-b8af-4a82-84e8-5344d9cd507b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:45.240593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-81f9a046-b8af-4a82-84e8-5344d9cd507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:45.300960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1103/2196] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:30:45.315866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20faefaf-60e1-4294-ae90-88fcc8027e11 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:45.317438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-20faefaf-60e1-4294-ae90-88fcc8027e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:45.346982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9a046-b8af-4a82-84e8-5344d9cd507b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.365425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4a629-b4d8-4d66-afc6-e7c69c739c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.366993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4a629-b4d8-4d66-afc6-e7c69c739c17 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.369311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4a629-b4d8-4d66-afc6-e7c69c739c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.369604 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4a629-b4d8-4d66-afc6-e7c69c739c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.370794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4a629-b4d8-4d66-afc6-e7c69c739c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.377590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4a629-b4d8-4d66-afc6-e7c69c739c17 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:45.410166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20faefaf-60e1-4294-ae90-88fcc8027e11 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.414385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566c2c-be0b-4ff7-b1c5-cd8a704c83c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.415041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566c2c-be0b-4ff7-b1c5-cd8a704c83c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.415320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566c2c-be0b-4ff7-b1c5-cd8a704c83c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.415597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c566c2c-be0b-4ff7-b1c5-cd8a704c83c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.418610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1094/2197] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:45 2022] POST /identity/v3/projects => generated 393 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:30:45.422905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4a629-b4d8-4d66-afc6-e7c69c739c17 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:45.429186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c566c2c-be0b-4ff7-b1c5-cd8a704c83c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.431715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c566c2c-be0b-4ff7-b1c5-cd8a704c83c1 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:45.442871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:45.448725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1104/2198] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:45.515186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4a629-b4d8-4d66-afc6-e7c69c739c17 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.525988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac957e4d-7585-466b-8d41-1657463c6a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.525988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac957e4d-7585-466b-8d41-1657463c6a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.525988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac957e4d-7585-466b-8d41-1657463c6a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.527576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac957e4d-7585-466b-8d41-1657463c6a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.527787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac957e4d-7585-466b-8d41-1657463c6a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.534382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac957e4d-7585-466b-8d41-1657463c6a27 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:45.563958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1095/2199] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:45 2022] POST /identity/v3/users => generated 303 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:45.565710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566c2c-be0b-4ff7-b1c5-cd8a704c83c1 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:45.601526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c566c2c-be0b-4ff7-b1c5-cd8a704c83c1 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.614007 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61293df9-9770-4ff7-9db1-fcc8248cd6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.614697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293df9-9770-4ff7-9db1-fcc8248cd6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.614983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293df9-9770-4ff7-9db1-fcc8248cd6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.615446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293df9-9770-4ff7-9db1-fcc8248cd6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.616219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61293df9-9770-4ff7-9db1-fcc8248cd6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.618206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61293df9-9770-4ff7-9db1-fcc8248cd6a6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:45.652218 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1105/2200] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:45.656302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac957e4d-7585-466b-8d41-1657463c6a27 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:45.671264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac957e4d-7585-466b-8d41-1657463c6a27 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.683481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362563f-d068-414f-b3e5-c68eef6d8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.683481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362563f-d068-414f-b3e5-c68eef6d8828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.683481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362563f-d068-414f-b3e5-c68eef6d8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.683481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362563f-d068-414f-b3e5-c68eef6d8828 admin admin] PATH_INFO: `/v3/projects/3c43edfd64fe4e7aad46cbc5cc7803c3/users/5278bf1d9f51424398eb943dbb8a3a7b/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.703481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362563f-d068-414f-b3e5-c68eef6d8828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c43edfd64fe4e7aad46cbc5cc7803c3, user_id=5278bf1d9f51424398eb943dbb8a3a7b, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.706386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362563f-d068-414f-b3e5-c68eef6d8828 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:45.731530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61293df9-9770-4ff7-9db1-fcc8248cd6a6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:45.739847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1096/2201] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:45 2022] PUT /identity/v3/projects/3c43edfd64fe4e7aad46cbc5cc7803c3/users/5278bf1d9f51424398eb943dbb8a3a7b/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:45.752553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61293df9-9770-4ff7-9db1-fcc8248cd6a6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.869091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098c33-d353-4fbd-90dd-7af827566506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.869792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098c33-d353-4fbd-90dd-7af827566506 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.870079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098c33-d353-4fbd-90dd-7af827566506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.870358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e098c33-d353-4fbd-90dd-7af827566506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.871584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e098c33-d353-4fbd-90dd-7af827566506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.873249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e098c33-d353-4fbd-90dd-7af827566506 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:45.890242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1106/2202] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:45.895755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362563f-d068-414f-b3e5-c68eef6d8828 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:45.909308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098c33-d353-4fbd-90dd-7af827566506 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:45.917260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7e098c33-d353-4fbd-90dd-7af827566506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:45.919661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362563f-d068-414f-b3e5-c68eef6d8828 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.938736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb9c13-0c42-4411-9929-7204ccb3c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.939859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb9c13-0c42-4411-9929-7204ccb3c217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.940309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb9c13-0c42-4411-9929-7204ccb3c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.940729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb9c13-0c42-4411-9929-7204ccb3c217 admin admin] PATH_INFO: `/v3/projects/3c43edfd64fe4e7aad46cbc5cc7803c3/users/5278bf1d9f51424398eb943dbb8a3a7b/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.941366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e098c33-d353-4fbd-90dd-7af827566506 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:45.944736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb9c13-0c42-4411-9929-7204ccb3c217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c43edfd64fe4e7aad46cbc5cc7803c3, user_id=5278bf1d9f51424398eb943dbb8a3a7b, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.948117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:45.950288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb9c13-0c42-4411-9929-7204ccb3c217 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:45.950423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:45.950978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:45.951288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] PATH_INFO: `/v3/projects/7980a28645eb4e3497f980a7383cbb33` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:45.952717 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7980a28645eb4e3497f980a7383cbb33)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:45.954755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:46.004098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1097/2203] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:45 2022] PUT /identity/v3/projects/3c43edfd64fe4e7aad46cbc5cc7803c3/users/5278bf1d9f51424398eb943dbb8a3a7b/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:46.014668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb89c02-a43c-4478-8c1d-4fb8359cd3e4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:46.014863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb89c02-a43c-4478-8c1d-4fb8359cd3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:46.015140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb89c02-a43c-4478-8c1d-4fb8359cd3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:46.039776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7980a28645eb4e3497f980a7383cbb33', 'request_id': 'req-e31cda4f-4c79-4c53-a675-e9ab6e6def59'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.052400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:46.053454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7980a28645eb4e3497f980a7383cbb33', 'request_id': 'req-e31cda4f-4c79-4c53-a675-e9ab6e6def59'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.068559 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1cb89c02-a43c-4478-8c1d-4fb8359cd3e4 None None] MFA Rules not processed for user `5278bf1d9f51424398eb943dbb8a3a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:46.070068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7980a28645eb4e3497f980a7383cbb33', 'request_id': 'req-e31cda4f-4c79-4c53-a675-e9ab6e6def59'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.070692 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1cb89c02-a43c-4478-8c1d-4fb8359cd3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:46.102747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] The token cache is being invalidate because project 7980a28645eb4e3497f980a7383cbb33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:46.103045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.105204 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.114711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1107/2204] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:45 2022] DELETE /identity/v3/projects/7980a28645eb4e3497f980a7383cbb33 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:46.115917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:46.118403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:46.202753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cda4f-4c79-4c53-a675-e9ab6e6def59 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:46.207561 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:46.208172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1098/2205] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:30:46.208864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:46.209151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:46.209427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] PATH_INFO: `/v3/users/66cc6326557344d8a1d10c7631774151` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:46.210624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] RBAC: Authorizing `identity:delete_user(user_id=66cc6326557344d8a1d10c7631774151)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:46.212600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:46.216483 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb89c02-a43c-4478-8c1d-4fb8359cd3e4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:46.218177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1cb89c02-a43c-4478-8c1d-4fb8359cd3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:46.225197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:46.270586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66cc6326557344d8a1d10c7631774151'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.272562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66cc6326557344d8a1d10c7631774151'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.284260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66cc6326557344d8a1d10c7631774151'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.285046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66cc6326557344d8a1d10c7631774151'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.289462 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb89c02-a43c-4478-8c1d-4fb8359cd3e4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:46.295223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7face0c-5250-4d15-81d6-f8d70385d2d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:46.295901 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7face0c-5250-4d15-81d6-f8d70385d2d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:46.296213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7face0c-5250-4d15-81d6-f8d70385d2d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:46.296488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7face0c-5250-4d15-81d6-f8d70385d2d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:46.298428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d7face0c-5250-4d15-81d6-f8d70385d2d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:46.298825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66cc6326557344d8a1d10c7631774151'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.314887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7face0c-5250-4d15-81d6-f8d70385d2d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:46.317798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7face0c-5250-4d15-81d6-f8d70385d2d1 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:46.321532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1108/2206] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:46 2022] DELETE /identity/v3/users/66cc6326557344d8a1d10c7631774151 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:46.329872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1099/2207] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:30:46.389836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:46.393884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:46.477251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b11e3-f9d1-47b4-b30b-56881747991f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:46.483950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a37e4-a853-42c6-b968-3aa9a2da7866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:46.485798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a37e4-a853-42c6-b968-3aa9a2da7866 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:46.486251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a37e4-a853-42c6-b968-3aa9a2da7866 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:46.486456 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a37e4-a853-42c6-b968-3aa9a2da7866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:46.489301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d20a37e4-a853-42c6-b968-3aa9a2da7866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:46.588275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a37e4-a853-42c6-b968-3aa9a2da7866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:46.590286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a37e4-a853-42c6-b968-3aa9a2da7866 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:46.600357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1109/2208] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:46.678816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7face0c-5250-4d15-81d6-f8d70385d2d1 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:46.680451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d7face0c-5250-4d15-81d6-f8d70385d2d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:46.711100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7face0c-5250-4d15-81d6-f8d70385d2d1 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:46.795080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:46.796231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:46.796437 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:46.796716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] PATH_INFO: `/v3/projects/c52c59b5fceb4d259d7484cf7a030217` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:46.798172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52c59b5fceb4d259d7484cf7a030217)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:46.800454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:46.852462 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:46.859603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52c59b5fceb4d259d7484cf7a030217', 'request_id': 'req-a1e57228-73c3-4ca3-9d33-60357ab6549d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.869355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52c59b5fceb4d259d7484cf7a030217', 'request_id': 'req-a1e57228-73c3-4ca3-9d33-60357ab6549d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.876875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52c59b5fceb4d259d7484cf7a030217', 'request_id': 'req-a1e57228-73c3-4ca3-9d33-60357ab6549d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.892372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] The token cache is being invalidate because project c52c59b5fceb4d259d7484cf7a030217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:46.892768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.893630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a1e57228-73c3-4ca3-9d33-60357ab6549d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:46.895769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1100/2209] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:46 2022] DELETE /identity/v3/projects/c52c59b5fceb4d259d7484cf7a030217 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:46.902209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed3aae-3fdc-470b-a982-712ef0e90bf6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:46.902747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed3aae-3fdc-470b-a982-712ef0e90bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:46.903106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed3aae-3fdc-470b-a982-712ef0e90bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:46.923882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2aed3aae-3fdc-470b-a982-712ef0e90bf6 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:46.925471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2aed3aae-3fdc-470b-a982-712ef0e90bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:46.978065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:47.011230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1110/2210] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:30:47.020826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11288ab-fc07-4e99-8fd9-dcef06956d42 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.021123 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11288ab-fc07-4e99-8fd9-dcef06956d42 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.021421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11288ab-fc07-4e99-8fd9-dcef06956d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.044591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f11288ab-fc07-4e99-8fd9-dcef06956d42 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:47.045810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f11288ab-fc07-4e99-8fd9-dcef06956d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:47.054358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1101/2211] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:47.058918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed3aae-3fdc-470b-a982-712ef0e90bf6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.068911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed3aae-3fdc-470b-a982-712ef0e90bf6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.073850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d85eb-0367-4f92-be4e-7951a0df154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.074518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d85eb-0367-4f92-be4e-7951a0df154a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.074802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d85eb-0367-4f92-be4e-7951a0df154a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.075082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d85eb-0367-4f92-be4e-7951a0df154a admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.075817 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d85eb-0367-4f92-be4e-7951a0df154a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:47.076157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d85eb-0367-4f92-be4e-7951a0df154a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.077775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d85eb-0367-4f92-be4e-7951a0df154a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.090597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1111/2212] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:30:47.094946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11288ab-fc07-4e99-8fd9-dcef06956d42 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.105107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11288ab-fc07-4e99-8fd9-dcef06956d42 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.109967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f8b8-7eb9-498a-961a-ede07ab4ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.110828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f8b8-7eb9-498a-961a-ede07ab4ee86 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.111117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f8b8-7eb9-498a-961a-ede07ab4ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.111395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697f8b8-7eb9-498a-961a-ede07ab4ee86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.112172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697f8b8-7eb9-498a-961a-ede07ab4ee86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.114103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697f8b8-7eb9-498a-961a-ede07ab4ee86 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.149364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1102/2213] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:47 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:47.154021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d85eb-0367-4f92-be4e-7951a0df154a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.166245 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d85eb-0367-4f92-be4e-7951a0df154a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.238421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36bd1b-de61-471b-86db-ecdd647200b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.240695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36bd1b-de61-471b-86db-ecdd647200b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.241147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36bd1b-de61-471b-86db-ecdd647200b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.241432 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36bd1b-de61-471b-86db-ecdd647200b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.242208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36bd1b-de61-471b-86db-ecdd647200b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.244126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36bd1b-de61-471b-86db-ecdd647200b8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.269355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1112/2214] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:47 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:47.273617 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f8b8-7eb9-498a-961a-ede07ab4ee86 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.288050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697f8b8-7eb9-498a-961a-ede07ab4ee86 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.290114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3b0c6-a5c3-4fe4-9892-e2b74bc45b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.290835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3b0c6-a5c3-4fe4-9892-e2b74bc45b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.291120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3b0c6-a5c3-4fe4-9892-e2b74bc45b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.291399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3b0c6-a5c3-4fe4-9892-e2b74bc45b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.292496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3b0c6-a5c3-4fe4-9892-e2b74bc45b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.298121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3b0c6-a5c3-4fe4-9892-e2b74bc45b73 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.311672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1103/2215] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:47.312610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36bd1b-de61-471b-86db-ecdd647200b8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.323496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36bd1b-de61-471b-86db-ecdd647200b8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.328936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b92bf0-5465-4e85-be10-effd1a573b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.329720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b92bf0-5465-4e85-be10-effd1a573b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.330025 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b92bf0-5465-4e85-be10-effd1a573b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.330441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b92bf0-5465-4e85-be10-effd1a573b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.331307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b92bf0-5465-4e85-be10-effd1a573b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.332980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b92bf0-5465-4e85-be10-effd1a573b9a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.344331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1113/2216] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:47.348514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3b0c6-a5c3-4fe4-9892-e2b74bc45b73 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.358806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3b0c6-a5c3-4fe4-9892-e2b74bc45b73 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.363895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211f8dc-6b05-4b39-b823-474523764f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.364982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211f8dc-6b05-4b39-b823-474523764f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.365125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211f8dc-6b05-4b39-b823-474523764f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.365396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211f8dc-6b05-4b39-b823-474523764f64 admin admin] PATH_INFO: `/v3/projects/10145bc4efc94618beb34d6f41562f91/users/88cc556e3a67441ca7938d94f9f263e5/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.382639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211f8dc-6b05-4b39-b823-474523764f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10145bc4efc94618beb34d6f41562f91, user_id=88cc556e3a67441ca7938d94f9f263e5, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.385402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211f8dc-6b05-4b39-b823-474523764f64 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.400392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1104/2217] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:47 2022] PUT /identity/v3/projects/10145bc4efc94618beb34d6f41562f91/users/88cc556e3a67441ca7938d94f9f263e5/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:47.411906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374b79f-809f-4c19-9e3a-9acdf48801fe None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.412856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374b79f-809f-4c19-9e3a-9acdf48801fe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.412856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374b79f-809f-4c19-9e3a-9acdf48801fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.443912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e374b79f-809f-4c19-9e3a-9acdf48801fe None None] MFA Rules not processed for user `88cc556e3a67441ca7938d94f9f263e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:47.445134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e374b79f-809f-4c19-9e3a-9acdf48801fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:47.515609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1114/2218] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:47.520282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211f8dc-6b05-4b39-b823-474523764f64 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.582929 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211f8dc-6b05-4b39-b823-474523764f64 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.587931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7ac3e-ecca-4927-a0bb-c1e5d567a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.588674 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7ac3e-ecca-4927-a0bb-c1e5d567a598 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.588961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7ac3e-ecca-4927-a0bb-c1e5d567a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.589271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7ac3e-ecca-4927-a0bb-c1e5d567a598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.590010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7ac3e-ecca-4927-a0bb-c1e5d567a598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.591944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7ac3e-ecca-4927-a0bb-c1e5d567a598 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.618726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1105/2219] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:47 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:47.622839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374b79f-809f-4c19-9e3a-9acdf48801fe None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.634703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374b79f-809f-4c19-9e3a-9acdf48801fe None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.668043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:47.692833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f319b41-c1ad-4cce-a151-ba1a211f3084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.693615 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f319b41-c1ad-4cce-a151-ba1a211f3084 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.693913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f319b41-c1ad-4cce-a151-ba1a211f3084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.694179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f319b41-c1ad-4cce-a151-ba1a211f3084 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.694908 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f319b41-c1ad-4cce-a151-ba1a211f3084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.697039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f319b41-c1ad-4cce-a151-ba1a211f3084 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.724594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1115/2220] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:47 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:47.728806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7ac3e-ecca-4927-a0bb-c1e5d567a598 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.741781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7ac3e-ecca-4927-a0bb-c1e5d567a598 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.747599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b93af-5939-4e9b-8642-c95fe8a1fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.748382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b93af-5939-4e9b-8642-c95fe8a1fcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.748663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b93af-5939-4e9b-8642-c95fe8a1fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.748934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b93af-5939-4e9b-8642-c95fe8a1fcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.749685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b93af-5939-4e9b-8642-c95fe8a1fcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.751350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b93af-5939-4e9b-8642-c95fe8a1fcd8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.764720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1106/2221] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:47.768508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f319b41-c1ad-4cce-a151-ba1a211f3084 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.779593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f319b41-c1ad-4cce-a151-ba1a211f3084 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.785015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f98044-40d6-40a3-b908-4204078e55ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.785703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f98044-40d6-40a3-b908-4204078e55ba admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.785978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f98044-40d6-40a3-b908-4204078e55ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.786261 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f98044-40d6-40a3-b908-4204078e55ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.787000 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f98044-40d6-40a3-b908-4204078e55ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.789174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f98044-40d6-40a3-b908-4204078e55ba admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.803628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1116/2222] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:47.804443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b93af-5939-4e9b-8642-c95fe8a1fcd8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:47.818939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b93af-5939-4e9b-8642-c95fe8a1fcd8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:47.825186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6756fe-8410-48d8-9e20-3b2a135c307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:47.826116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6756fe-8410-48d8-9e20-3b2a135c307e admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.826402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6756fe-8410-48d8-9e20-3b2a135c307e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.826684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6756fe-8410-48d8-9e20-3b2a135c307e admin admin] PATH_INFO: `/v3/projects/31fabcbe0ca6498189e75f98f87edd46/users/1a85bec82a804036abb946f7a3e9cb31/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.843452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6756fe-8410-48d8-9e20-3b2a135c307e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fabcbe0ca6498189e75f98f87edd46, user_id=1a85bec82a804036abb946f7a3e9cb31, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:47.846300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6756fe-8410-48d8-9e20-3b2a135c307e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:47.871638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1107/2223] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:47 2022] PUT /identity/v3/projects/31fabcbe0ca6498189e75f98f87edd46/users/1a85bec82a804036abb946f7a3e9cb31/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:47.882134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9e2b-cd6d-4028-84c9-680e82b3319f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:47.882418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9e2b-cd6d-4028-84c9-680e82b3319f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:47.882730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9e2b-cd6d-4028-84c9-680e82b3319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:47.909868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-14be9e2b-cd6d-4028-84c9-680e82b3319f None None] MFA Rules not processed for user `1a85bec82a804036abb946f7a3e9cb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:47.911064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-14be9e2b-cd6d-4028-84c9-680e82b3319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:47.978770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1117/2224] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:47.983738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6756fe-8410-48d8-9e20-3b2a135c307e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:48.006624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:48.067567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6756fe-8410-48d8-9e20-3b2a135c307e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:48.072979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87611c9-7d28-46c2-9908-470cfd174ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:48.073889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87611c9-7d28-46c2-9908-470cfd174ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:48.074194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87611c9-7d28-46c2-9908-470cfd174ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:48.074472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87611c9-7d28-46c2-9908-470cfd174ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:48.075213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87611c9-7d28-46c2-9908-470cfd174ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:48.077190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87611c9-7d28-46c2-9908-470cfd174ed9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:48.108045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1108/2225] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:47 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:48.111221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9e2b-cd6d-4028-84c9-680e82b3319f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:48.122370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9e2b-cd6d-4028-84c9-680e82b3319f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:48.182125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709aabbf-3815-4f90-83ed-27851ccb32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:48.182737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aabbf-3815-4f90-83ed-27851ccb32ed admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:48.183034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aabbf-3815-4f90-83ed-27851ccb32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:48.183329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aabbf-3815-4f90-83ed-27851ccb32ed admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:48.184182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709aabbf-3815-4f90-83ed-27851ccb32ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:48.186101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709aabbf-3815-4f90-83ed-27851ccb32ed admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:48.208217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1118/2226] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:48 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:48.214013 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87611c9-7d28-46c2-9908-470cfd174ed9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:48.225633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87611c9-7d28-46c2-9908-470cfd174ed9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:48.240190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f4dd9-76ae-4ab3-bd66-a53f8fe5ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:48.240886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f4dd9-76ae-4ab3-bd66-a53f8fe5ea76 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:48.241169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f4dd9-76ae-4ab3-bd66-a53f8fe5ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:48.241465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f4dd9-76ae-4ab3-bd66-a53f8fe5ea76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:48.242213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f4dd9-76ae-4ab3-bd66-a53f8fe5ea76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:48.244295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f4dd9-76ae-4ab3-bd66-a53f8fe5ea76 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:48.261084 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1109/2227] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:48.262690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709aabbf-3815-4f90-83ed-27851ccb32ed admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:48.275811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709aabbf-3815-4f90-83ed-27851ccb32ed admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:48.282068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67238e1-9897-4ea4-ae39-51fde5068205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:48.282971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67238e1-9897-4ea4-ae39-51fde5068205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:48.283384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67238e1-9897-4ea4-ae39-51fde5068205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:48.283667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67238e1-9897-4ea4-ae39-51fde5068205 admin admin] PATH_INFO: `/v3/projects/7ff35a5bc8414eb0a7da97f9acd9586e/users/f5eb5872c087435a9d438bb0a2a18152/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:48.308756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67238e1-9897-4ea4-ae39-51fde5068205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff35a5bc8414eb0a7da97f9acd9586e, user_id=f5eb5872c087435a9d438bb0a2a18152, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:48.311673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67238e1-9897-4ea4-ae39-51fde5068205 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:48.327038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1119/2228] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:48 2022] PUT /identity/v3/projects/7ff35a5bc8414eb0a7da97f9acd9586e/users/f5eb5872c087435a9d438bb0a2a18152/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:48.331085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f4dd9-76ae-4ab3-bd66-a53f8fe5ea76 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:48.344437 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f4dd9-76ae-4ab3-bd66-a53f8fe5ea76 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:48.423157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66a8a3-4342-4e62-890d-4b896f911c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:48.424671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a8a3-4342-4e62-890d-4b896f911c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:48.426345 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a8a3-4342-4e62-890d-4b896f911c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:48.427159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a8a3-4342-4e62-890d-4b896f911c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:48.427406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66a8a3-4342-4e62-890d-4b896f911c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:48.429154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66a8a3-4342-4e62-890d-4b896f911c11 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:48.448038 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1110/2229] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:48.453132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67238e1-9897-4ea4-ae39-51fde5068205 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:48.466164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67238e1-9897-4ea4-ae39-51fde5068205 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:48.472702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d4e7-0e46-43cd-b865-dde076e51845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:48.473619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d4e7-0e46-43cd-b865-dde076e51845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:48.473909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d4e7-0e46-43cd-b865-dde076e51845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:48.474181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d4e7-0e46-43cd-b865-dde076e51845 admin admin] PATH_INFO: `/v3/projects/7ff35a5bc8414eb0a7da97f9acd9586e/users/f5eb5872c087435a9d438bb0a2a18152/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:48.478118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6d4e7-0e46-43cd-b865-dde076e51845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff35a5bc8414eb0a7da97f9acd9586e, user_id=f5eb5872c087435a9d438bb0a2a18152, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:48.480917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6d4e7-0e46-43cd-b865-dde076e51845 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:48.490248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:48.507808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1120/2230] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:48 2022] PUT /identity/v3/projects/7ff35a5bc8414eb0a7da97f9acd9586e/users/f5eb5872c087435a9d438bb0a2a18152/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:48.509708 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99289c-442d-4c0d-9b7d-d39e80ecefd6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:48.510006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99289c-442d-4c0d-9b7d-d39e80ecefd6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:48.510284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99289c-442d-4c0d-9b7d-d39e80ecefd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:48.561060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5f99289c-442d-4c0d-9b7d-d39e80ecefd6 None None] MFA Rules not processed for user `f5eb5872c087435a9d438bb0a2a18152`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:48.561060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5f99289c-442d-4c0d-9b7d-d39e80ecefd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:48.661626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1111/2231] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:48.678423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d4e7-0e46-43cd-b865-dde076e51845 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:48.680283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a8a6d4e7-0e46-43cd-b865-dde076e51845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:48.748426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d4e7-0e46-43cd-b865-dde076e51845 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:48.752486 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e4c17-c798-448b-849b-73ca32b599cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:48.753190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e4c17-c798-448b-849b-73ca32b599cc service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:48.753462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e4c17-c798-448b-849b-73ca32b599cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:48.753768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e4c17-c798-448b-849b-73ca32b599cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:48.763836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e4c17-c798-448b-849b-73ca32b599cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:48.765323 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e4c17-c798-448b-849b-73ca32b599cc service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:48.775042 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1121/2232] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:49.450234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99289c-442d-4c0d-9b7d-d39e80ecefd6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:49.461236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99289c-442d-4c0d-9b7d-d39e80ecefd6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:49.466515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327a9ce-f69f-47e6-ab05-8c27b1a44d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:49.467192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327a9ce-f69f-47e6-ab05-8c27b1a44d96 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:49.467795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327a9ce-f69f-47e6-ab05-8c27b1a44d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:49.468062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327a9ce-f69f-47e6-ab05-8c27b1a44d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:49.484961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:49.561295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327a9ce-f69f-47e6-ab05-8c27b1a44d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:49.563562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327a9ce-f69f-47e6-ab05-8c27b1a44d96 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:49.581169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1112/2233] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:50.407674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e4c17-c798-448b-849b-73ca32b599cc service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:50.409374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-588e4c17-c798-448b-849b-73ca32b599cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:50.489237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e4c17-c798-448b-849b-73ca32b599cc service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:50.494338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:50.495229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:50.495526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:50.495799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] PATH_INFO: `/v3/users/bc5c3686783749cfbeda90d69270c515` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:50.497043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5c3686783749cfbeda90d69270c515)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:50.498969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:50.555139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5c3686783749cfbeda90d69270c515'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:50.555867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5c3686783749cfbeda90d69270c515'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:50.574767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5c3686783749cfbeda90d69270c515'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:50.575516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5c3686783749cfbeda90d69270c515'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:50.586800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5c3686783749cfbeda90d69270c515'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:50.598335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1122/2234] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:50 2022] DELETE /identity/v3/users/bc5c3686783749cfbeda90d69270c515 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:50.603298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61617c7f-5cd5-4e95-bcd7-e346c8dfa06d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:50.603760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61617c7f-5cd5-4e95-bcd7-e346c8dfa06d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:50.604411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61617c7f-5cd5-4e95-bcd7-e346c8dfa06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:50.626856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-61617c7f-5cd5-4e95-bcd7-e346c8dfa06d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:50.628205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-61617c7f-5cd5-4e95-bcd7-e346c8dfa06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:50.727364 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1113/2235] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:50.734551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:50.736353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:50.768888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:50.909817 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda3ba2-3233-4bc8-a99a-008b58de565f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:50.918915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755b70f-1f46-4a6a-89a4-c56be1ae447e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:50.919871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755b70f-1f46-4a6a-89a4-c56be1ae447e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:50.920153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755b70f-1f46-4a6a-89a4-c56be1ae447e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:50.923216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755b70f-1f46-4a6a-89a4-c56be1ae447e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:50.947152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755b70f-1f46-4a6a-89a4-c56be1ae447e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:50.948535 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755b70f-1f46-4a6a-89a4-c56be1ae447e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:50.987579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1123/2236] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:51.721443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61617c7f-5cd5-4e95-bcd7-e346c8dfa06d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:51.726702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-61617c7f-5cd5-4e95-bcd7-e346c8dfa06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:51.782291 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61617c7f-5cd5-4e95-bcd7-e346c8dfa06d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:51.800418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:51.801350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:51.801631 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:51.801927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] PATH_INFO: `/v3/projects/ced8ab69118a4ddb92d292db7d9f7cca` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:51.805351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced8ab69118a4ddb92d292db7d9f7cca)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:51.807523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:51.899946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced8ab69118a4ddb92d292db7d9f7cca', 'request_id': 'req-392d9da5-4183-4623-a22e-adcbb3879f51'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:51.907144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced8ab69118a4ddb92d292db7d9f7cca', 'request_id': 'req-392d9da5-4183-4623-a22e-adcbb3879f51'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:51.918325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced8ab69118a4ddb92d292db7d9f7cca', 'request_id': 'req-392d9da5-4183-4623-a22e-adcbb3879f51'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:51.941491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] The token cache is being invalidate because project ced8ab69118a4ddb92d292db7d9f7cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:51.942044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:51.942940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-392d9da5-4183-4623-a22e-adcbb3879f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:51.945136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1114/2237] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:51 2022] DELETE /identity/v3/projects/ced8ab69118a4ddb92d292db7d9f7cca => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:51.949877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0475-d86d-469b-a581-7589d859c9f1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:51.950802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0475-d86d-469b-a581-7589d859c9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:51.951569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0475-d86d-469b-a581-7589d859c9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:51.989139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-73fb0475-d86d-469b-a581-7589d859c9f1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:51.990711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-73fb0475-d86d-469b-a581-7589d859c9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:52.080923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1124/2238] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:30:52.091523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d86fd-82e7-4b82-998e-2e3dfd721482 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:52.091806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d86fd-82e7-4b82-998e-2e3dfd721482 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:52.093948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d86fd-82e7-4b82-998e-2e3dfd721482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:52.124614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-309d86fd-82e7-4b82-998e-2e3dfd721482 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:52.126249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-309d86fd-82e7-4b82-998e-2e3dfd721482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:52.140941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1115/2239] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:52.145580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0475-d86d-469b-a581-7589d859c9f1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:52.159114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0475-d86d-469b-a581-7589d859c9f1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:52.171366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab99f40-a474-4d6e-8ef2-5bff038fcbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:52.172538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99f40-a474-4d6e-8ef2-5bff038fcbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:52.173006 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99f40-a474-4d6e-8ef2-5bff038fcbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:52.180096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99f40-a474-4d6e-8ef2-5bff038fcbb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:52.180096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab99f40-a474-4d6e-8ef2-5bff038fcbb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:52.180096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab99f40-a474-4d6e-8ef2-5bff038fcbb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:52.180096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab99f40-a474-4d6e-8ef2-5bff038fcbb3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:52.194427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1125/2240] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:30:52.199590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d86fd-82e7-4b82-998e-2e3dfd721482 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:52.209949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d86fd-82e7-4b82-998e-2e3dfd721482 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:52.215038 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11026b-9ed3-421f-a35f-4a66948e5a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:52.215730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11026b-9ed3-421f-a35f-4a66948e5a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:52.216086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11026b-9ed3-421f-a35f-4a66948e5a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:52.216360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11026b-9ed3-421f-a35f-4a66948e5a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:52.217153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11026b-9ed3-421f-a35f-4a66948e5a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:52.219570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11026b-9ed3-421f-a35f-4a66948e5a0e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:52.264756 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1116/2241] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:52 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:52.267930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab99f40-a474-4d6e-8ef2-5bff038fcbb3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:52.293354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab99f40-a474-4d6e-8ef2-5bff038fcbb3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:52.441092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5100c3f-256f-44ee-b5c2-02ce8e09d24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:52.441962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5100c3f-256f-44ee-b5c2-02ce8e09d24d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:52.442256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5100c3f-256f-44ee-b5c2-02ce8e09d24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:52.442537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5100c3f-256f-44ee-b5c2-02ce8e09d24d admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:52.443248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5100c3f-256f-44ee-b5c2-02ce8e09d24d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:52.446059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5100c3f-256f-44ee-b5c2-02ce8e09d24d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:52.507319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1126/2242] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:52 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:52.511995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11026b-9ed3-421f-a35f-4a66948e5a0e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:52.524504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:52.528073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11026b-9ed3-421f-a35f-4a66948e5a0e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:52.536252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88afca-a3b1-48b9-9c3b-7d7736378e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:52.536962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88afca-a3b1-48b9-9c3b-7d7736378e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:52.537511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88afca-a3b1-48b9-9c3b-7d7736378e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:52.537777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88afca-a3b1-48b9-9c3b-7d7736378e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:52.539113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88afca-a3b1-48b9-9c3b-7d7736378e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:52.542648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88afca-a3b1-48b9-9c3b-7d7736378e53 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:52.564392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1117/2243] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:52.566467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5100c3f-256f-44ee-b5c2-02ce8e09d24d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:52.580165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5100c3f-256f-44ee-b5c2-02ce8e09d24d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:52.585629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c91c6d-a8ef-4bda-bdb4-56cdf66d736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:52.586764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91c6d-a8ef-4bda-bdb4-56cdf66d736f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:52.587402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91c6d-a8ef-4bda-bdb4-56cdf66d736f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:52.587960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91c6d-a8ef-4bda-bdb4-56cdf66d736f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:52.588765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c91c6d-a8ef-4bda-bdb4-56cdf66d736f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:52.590693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c91c6d-a8ef-4bda-bdb4-56cdf66d736f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:52.605011 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1127/2244] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:52.609881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88afca-a3b1-48b9-9c3b-7d7736378e53 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:52.622108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88afca-a3b1-48b9-9c3b-7d7736378e53 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:52.627291 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d9a60-0863-48b8-a65b-b38dc28a1c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:52.628279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d9a60-0863-48b8-a65b-b38dc28a1c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:52.628562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d9a60-0863-48b8-a65b-b38dc28a1c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:52.629355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d9a60-0863-48b8-a65b-b38dc28a1c38 admin admin] PATH_INFO: `/v3/projects/9464daf7da9f4365a249e8256468b2f6/users/a72b12ceaeb343dc893b330875d85be6/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:52.649204 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d9a60-0863-48b8-a65b-b38dc28a1c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9464daf7da9f4365a249e8256468b2f6, user_id=a72b12ceaeb343dc893b330875d85be6, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:52.653661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d9a60-0863-48b8-a65b-b38dc28a1c38 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:52.682215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1118/2245] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:52 2022] PUT /identity/v3/projects/9464daf7da9f4365a249e8256468b2f6/users/a72b12ceaeb343dc893b330875d85be6/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:52.683970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deee466-d2bc-4d29-916c-03f86b3af1d2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:52.684509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deee466-d2bc-4d29-916c-03f86b3af1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:52.684791 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deee466-d2bc-4d29-916c-03f86b3af1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:52.698390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d9a60-0863-48b8-a65b-b38dc28a1c38 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:52.705753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-990d9a60-0863-48b8-a65b-b38dc28a1c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:52.726348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7deee466-d2bc-4d29-916c-03f86b3af1d2 None None] MFA Rules not processed for user `a72b12ceaeb343dc893b330875d85be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:52.727551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7deee466-d2bc-4d29-916c-03f86b3af1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:52.755327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:52.821909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d9a60-0863-48b8-a65b-b38dc28a1c38 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:52.826926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1128/2246] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:52.831037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:52.831880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deee466-d2bc-4d29-916c-03f86b3af1d2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:52.832119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:52.832523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:52.833047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] PATH_INFO: `/v3/users/75bf6892d91347328dedb56ecb36c1ad` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:52.836953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bf6892d91347328dedb56ecb36c1ad)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:52.839105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:52.847584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deee466-d2bc-4d29-916c-03f86b3af1d2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:52.857834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ef66e-917a-4205-b595-04178d342ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:52.859443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ef66e-917a-4205-b595-04178d342ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:52.859749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ef66e-917a-4205-b595-04178d342ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:52.860067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ef66e-917a-4205-b595-04178d342ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:52.860788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ef66e-917a-4205-b595-04178d342ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:52.863090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ef66e-917a-4205-b595-04178d342ec7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:52.911274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1129/2247] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:52 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:52.913450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ef66e-917a-4205-b595-04178d342ec7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:52.949459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bf6892d91347328dedb56ecb36c1ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:52.976314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bf6892d91347328dedb56ecb36c1ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:53.022034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bf6892d91347328dedb56ecb36c1ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:53.039927 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bf6892d91347328dedb56ecb36c1ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:53.041666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ae81cdad-78cb-4423-8a7f-b59ec9cb03bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bf6892d91347328dedb56ecb36c1ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:53.059325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ef66e-917a-4205-b595-04178d342ec7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:53.065550 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1119/2248] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:52 2022] DELETE /identity/v3/users/75bf6892d91347328dedb56ecb36c1ad => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:53.070202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4d165-82d9-4d40-af6f-f1529216bbe9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:53.070653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4d165-82d9-4d40-af6f-f1529216bbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:53.070783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4d165-82d9-4d40-af6f-f1529216bbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:53.131850 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-14e4d165-82d9-4d40-af6f-f1529216bbe9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:53.135498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-14e4d165-82d9-4d40-af6f-f1529216bbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:53.201490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761491b-59bc-4654-b61c-45b138dbff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:53.202191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761491b-59bc-4654-b61c-45b138dbff1f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:53.202490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761491b-59bc-4654-b61c-45b138dbff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:53.202878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761491b-59bc-4654-b61c-45b138dbff1f admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:53.203594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761491b-59bc-4654-b61c-45b138dbff1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:53.205795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761491b-59bc-4654-b61c-45b138dbff1f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:53.269697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1130/2249] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:52 2022] POST /identity/v3/users => generated 293 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:30:53.271418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761491b-59bc-4654-b61c-45b138dbff1f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:53.274250 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0761491b-59bc-4654-b61c-45b138dbff1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:53.285267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:53.298683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761491b-59bc-4654-b61c-45b138dbff1f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:53.319956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4ff71-f157-4689-b246-516f843dd31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:53.321349 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4ff71-f157-4689-b246-516f843dd31f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:53.321643 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4ff71-f157-4689-b246-516f843dd31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:53.321926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4ff71-f157-4689-b246-516f843dd31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:53.322675 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4ff71-f157-4689-b246-516f843dd31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:53.326802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4ff71-f157-4689-b246-516f843dd31f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:53.350807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1131/2250] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:53.351818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1120/2251] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:30:53.354568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4d165-82d9-4d40-af6f-f1529216bbe9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:53.356268 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4ff71-f157-4689-b246-516f843dd31f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:53.358977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-14e4d165-82d9-4d40-af6f-f1529216bbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:53.377834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4ff71-f157-4689-b246-516f843dd31f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:53.383785 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee7673-630b-4beb-b567-b750dc6d2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:53.384542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7673-630b-4beb-b567-b750dc6d2d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:53.386559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7673-630b-4beb-b567-b750dc6d2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:53.386559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7673-630b-4beb-b567-b750dc6d2d05 admin admin] PATH_INFO: `/v3/projects/621d4c2347d94583bfc7b4c959c47176/users/845e0818eff645ff8d6114b5dbc25a73/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:53.408582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee7673-630b-4beb-b567-b750dc6d2d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621d4c2347d94583bfc7b4c959c47176, user_id=845e0818eff645ff8d6114b5dbc25a73, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:53.414586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee7673-630b-4beb-b567-b750dc6d2d05 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:53.428982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:53.441431 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1132/2252] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:53 2022] PUT /identity/v3/projects/621d4c2347d94583bfc7b4c959c47176/users/845e0818eff645ff8d6114b5dbc25a73/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:53.452019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4d165-82d9-4d40-af6f-f1529216bbe9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:53.453571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee7673-630b-4beb-b567-b750dc6d2d05 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:53.529079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8a1d2-fa46-49dc-8075-b50f5edd42ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:53.529752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a1d2-fa46-49dc-8075-b50f5edd42ba service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:53.530182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a1d2-fa46-49dc-8075-b50f5edd42ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:53.530343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a1d2-fa46-49dc-8075-b50f5edd42ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:53.545270 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee7673-630b-4beb-b567-b750dc6d2d05 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:53.554448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe27f6b-896d-4031-b387-2ec1d055b7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:53.555196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe27f6b-896d-4031-b387-2ec1d055b7de admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:53.555530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe27f6b-896d-4031-b387-2ec1d055b7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:53.555749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe27f6b-896d-4031-b387-2ec1d055b7de admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:53.556683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe27f6b-896d-4031-b387-2ec1d055b7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:53.558378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe27f6b-896d-4031-b387-2ec1d055b7de admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:53.576309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1133/2253] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:53.577432 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe27f6b-896d-4031-b387-2ec1d055b7de admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:53.593160 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe27f6b-896d-4031-b387-2ec1d055b7de admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:53.600192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f44de-8f73-4327-b571-285c44cff7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:53.601420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f44de-8f73-4327-b571-285c44cff7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:53.602063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f44de-8f73-4327-b571-285c44cff7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:53.602668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f44de-8f73-4327-b571-285c44cff7ad admin admin] PATH_INFO: `/v3/projects/621d4c2347d94583bfc7b4c959c47176/users/845e0818eff645ff8d6114b5dbc25a73/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:53.616233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8a1d2-fa46-49dc-8075-b50f5edd42ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:53.617831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8a1d2-fa46-49dc-8075-b50f5edd42ba service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:53.620273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f44de-8f73-4327-b571-285c44cff7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=621d4c2347d94583bfc7b4c959c47176, user_id=845e0818eff645ff8d6114b5dbc25a73, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:53.632839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1121/2254] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:30:53.633333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f44de-8f73-4327-b571-285c44cff7ad admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:53.657182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1134/2255] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:53 2022] PUT /identity/v3/projects/621d4c2347d94583bfc7b4c959c47176/users/845e0818eff645ff8d6114b5dbc25a73/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:53.669004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143e4e2-79fe-49ca-987a-9413f43d903f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:53.669597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143e4e2-79fe-49ca-987a-9413f43d903f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:53.670168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143e4e2-79fe-49ca-987a-9413f43d903f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:53.733292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0143e4e2-79fe-49ca-987a-9413f43d903f None None] MFA Rules not processed for user `845e0818eff645ff8d6114b5dbc25a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:53.734528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0143e4e2-79fe-49ca-987a-9413f43d903f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:53.796395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:53.828972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1122/2256] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:53.852380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f44de-8f73-4327-b571-285c44cff7ad admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:53.855315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5e9f44de-8f73-4327-b571-285c44cff7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:53.949444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f44de-8f73-4327-b571-285c44cff7ad admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:53.957210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0460d-2eff-48a6-bfc1-c4ffb8b69f60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:53.958947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0460d-2eff-48a6-bfc1-c4ffb8b69f60 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:53.959586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0460d-2eff-48a6-bfc1-c4ffb8b69f60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:53.960073 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0460d-2eff-48a6-bfc1-c4ffb8b69f60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:53.962538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d3e0460d-2eff-48a6-bfc1-c4ffb8b69f60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:54.049813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0460d-2eff-48a6-bfc1-c4ffb8b69f60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:54.051466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0460d-2eff-48a6-bfc1-c4ffb8b69f60 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:54.065252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1135/2257] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:54.172445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143e4e2-79fe-49ca-987a-9413f43d903f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:54.175399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0143e4e2-79fe-49ca-987a-9413f43d903f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:54.311784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143e4e2-79fe-49ca-987a-9413f43d903f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:54.326292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:54.328822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:54.329489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:54.329734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] PATH_INFO: `/v3/projects/1807ecf2ac8a417cb00cd19a50274253` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:54.331268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1807ecf2ac8a417cb00cd19a50274253)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:54.333352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:54.403622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1807ecf2ac8a417cb00cd19a50274253', 'request_id': 'req-b965be3e-46d2-4913-b05d-2817cabc1db3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:54.410936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1807ecf2ac8a417cb00cd19a50274253', 'request_id': 'req-b965be3e-46d2-4913-b05d-2817cabc1db3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:54.420077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1807ecf2ac8a417cb00cd19a50274253', 'request_id': 'req-b965be3e-46d2-4913-b05d-2817cabc1db3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:54.437238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] The token cache is being invalidate because project 1807ecf2ac8a417cb00cd19a50274253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:54.438091 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:54.439014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:54.446507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1123/2258] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:54 2022] DELETE /identity/v3/projects/1807ecf2ac8a417cb00cd19a50274253 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:54.450299 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0460d-2eff-48a6-bfc1-c4ffb8b69f60 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:54.466624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0460d-2eff-48a6-bfc1-c4ffb8b69f60 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:54.542149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:54.616731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:54.619155 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:54.620670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:54.621158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] PATH_INFO: `/v3/users/5278bf1d9f51424398eb943dbb8a3a7b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:54.623121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5278bf1d9f51424398eb943dbb8a3a7b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:54.627602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:54.791684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5278bf1d9f51424398eb943dbb8a3a7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:54.796952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5278bf1d9f51424398eb943dbb8a3a7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:54.863223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5278bf1d9f51424398eb943dbb8a3a7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:54.866473 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5278bf1d9f51424398eb943dbb8a3a7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:54.892030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5278bf1d9f51424398eb943dbb8a3a7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:54.924660 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1136/2259] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:54 2022] DELETE /identity/v3/users/5278bf1d9f51424398eb943dbb8a3a7b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:54.961936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:54.963909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:55.037116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965be3e-46d2-4913-b05d-2817cabc1db3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:55.062778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:55.094220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96f865-1b26-4f88-b6ef-8621f397316a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:55.094902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96f865-1b26-4f88-b6ef-8621f397316a service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:55.095182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96f865-1b26-4f88-b6ef-8621f397316a service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:55.095451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96f865-1b26-4f88-b6ef-8621f397316a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:55.097263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1b96f865-1b26-4f88-b6ef-8621f397316a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:55.180072 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96f865-1b26-4f88-b6ef-8621f397316a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:55.181571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96f865-1b26-4f88-b6ef-8621f397316a service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:55.192062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1124/2260] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:55.260106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:55.261905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:55.380929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35281ea5-3396-4b46-95e1-f94a77301d03 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:55.387866 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:55.388905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:55.389254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:55.389593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] PATH_INFO: `/v3/projects/3c43edfd64fe4e7aad46cbc5cc7803c3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:55.391191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c43edfd64fe4e7aad46cbc5cc7803c3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:55.393254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:55.449171 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c43edfd64fe4e7aad46cbc5cc7803c3', 'request_id': 'req-26f53e7e-3703-46ba-9c90-11253a76cc95'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:55.457574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c43edfd64fe4e7aad46cbc5cc7803c3', 'request_id': 'req-26f53e7e-3703-46ba-9c90-11253a76cc95'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:55.458994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:55.467612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c43edfd64fe4e7aad46cbc5cc7803c3', 'request_id': 'req-26f53e7e-3703-46ba-9c90-11253a76cc95'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:55.482203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] The token cache is being invalidate because project 3c43edfd64fe4e7aad46cbc5cc7803c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:55.482832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:55.483496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26f53e7e-3703-46ba-9c90-11253a76cc95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:55.485512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1137/2261] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:55 2022] DELETE /identity/v3/projects/3c43edfd64fe4e7aad46cbc5cc7803c3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:55.490905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e99ba5-c0e3-4002-b40b-1982fd115448 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:55.491610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e99ba5-c0e3-4002-b40b-1982fd115448 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:55.491941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e99ba5-c0e3-4002-b40b-1982fd115448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:55.510655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c6e99ba5-c0e3-4002-b40b-1982fd115448 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:55.512051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c6e99ba5-c0e3-4002-b40b-1982fd115448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:55.581006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1125/2262] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:55.590993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d7de-a219-4f18-bc7b-46e30b32d9af None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:55.591305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d7de-a219-4f18-bc7b-46e30b32d9af None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:55.591572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433d7de-a219-4f18-bc7b-46e30b32d9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:55.611713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3433d7de-a219-4f18-bc7b-46e30b32d9af None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:55.613011 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3433d7de-a219-4f18-bc7b-46e30b32d9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:55.621393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1138/2263] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:55.626146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e99ba5-c0e3-4002-b40b-1982fd115448 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:55.636826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e99ba5-c0e3-4002-b40b-1982fd115448 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:55.641167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a566cdf-1ef3-4304-a8f9-413489fdb534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:55.641828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566cdf-1ef3-4304-a8f9-413489fdb534 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:55.642111 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566cdf-1ef3-4304-a8f9-413489fdb534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:55.642382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a566cdf-1ef3-4304-a8f9-413489fdb534 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:55.643116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a566cdf-1ef3-4304-a8f9-413489fdb534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:55.643492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a566cdf-1ef3-4304-a8f9-413489fdb534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:55.645153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a566cdf-1ef3-4304-a8f9-413489fdb534 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:55.663494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1126/2264] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:30:55.665072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433d7de-a219-4f18-bc7b-46e30b32d9af None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:55.677029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433d7de-a219-4f18-bc7b-46e30b32d9af None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:55.685008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0f38e-f588-4ff0-8882-f01bc5a7b77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:55.686201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0f38e-f588-4ff0-8882-f01bc5a7b77d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:55.686691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0f38e-f588-4ff0-8882-f01bc5a7b77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:55.687164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0f38e-f588-4ff0-8882-f01bc5a7b77d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:55.688387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0f38e-f588-4ff0-8882-f01bc5a7b77d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:55.691934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0f38e-f588-4ff0-8882-f01bc5a7b77d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:55.735451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1139/2265] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:55 2022] POST /identity/v3/projects => generated 409 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:55.739417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a566cdf-1ef3-4304-a8f9-413489fdb534 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:55.751200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a566cdf-1ef3-4304-a8f9-413489fdb534 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:55.856628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a6323-d885-4c55-9aa1-14cc4c22147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:55.857322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a6323-d885-4c55-9aa1-14cc4c22147a admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:55.857619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a6323-d885-4c55-9aa1-14cc4c22147a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:55.858019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a6323-d885-4c55-9aa1-14cc4c22147a admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:55.858774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a6323-d885-4c55-9aa1-14cc4c22147a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:55.860954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a6323-d885-4c55-9aa1-14cc4c22147a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:55.885792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:55.903553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1127/2266] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:55 2022] POST /identity/v3/users => generated 305 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:30:55.912079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0f38e-f588-4ff0-8882-f01bc5a7b77d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:55.936609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0f38e-f588-4ff0-8882-f01bc5a7b77d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:55.946291 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691475b2-2c29-4224-a6fe-4b8dfc2c3225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:55.955066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691475b2-2c29-4224-a6fe-4b8dfc2c3225 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:55.955066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691475b2-2c29-4224-a6fe-4b8dfc2c3225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:55.955066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691475b2-2c29-4224-a6fe-4b8dfc2c3225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:55.955066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691475b2-2c29-4224-a6fe-4b8dfc2c3225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:55.955066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691475b2-2c29-4224-a6fe-4b8dfc2c3225 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:55.972713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1140/2267] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:55.974127 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a6323-d885-4c55-9aa1-14cc4c22147a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:55.998581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a6323-d885-4c55-9aa1-14cc4c22147a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:56.005313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afef3d9-3530-4a1f-b9d5-3ad4440e389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:56.006199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afef3d9-3530-4a1f-b9d5-3ad4440e389c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.006563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afef3d9-3530-4a1f-b9d5-3ad4440e389c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.006917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afef3d9-3530-4a1f-b9d5-3ad4440e389c admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.007773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afef3d9-3530-4a1f-b9d5-3ad4440e389c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:56.010657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afef3d9-3530-4a1f-b9d5-3ad4440e389c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:56.027590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1128/2268] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:56.032684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691475b2-2c29-4224-a6fe-4b8dfc2c3225 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:56.050181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691475b2-2c29-4224-a6fe-4b8dfc2c3225 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:56.058604 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c380-9f3b-479d-9d6c-ab00cce8db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:56.060743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c380-9f3b-479d-9d6c-ab00cce8db46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.061967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c380-9f3b-479d-9d6c-ab00cce8db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.062386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c380-9f3b-479d-9d6c-ab00cce8db46 admin admin] PATH_INFO: `/v3/projects/758ad81924a34c629db5394cebcb2ee7/users/70d3373921064830869e151adb0bfb1d/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.094084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6c380-9f3b-479d-9d6c-ab00cce8db46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758ad81924a34c629db5394cebcb2ee7, user_id=70d3373921064830869e151adb0bfb1d, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:56.108870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6c380-9f3b-479d-9d6c-ab00cce8db46 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:56.140319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1141/2269] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:56 2022] PUT /identity/v3/projects/758ad81924a34c629db5394cebcb2ee7/users/70d3373921064830869e151adb0bfb1d/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:56.151237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664be54d-7d41-4f49-9148-abd4c7da9cb5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.151636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664be54d-7d41-4f49-9148-abd4c7da9cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.152195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664be54d-7d41-4f49-9148-abd4c7da9cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.205032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-664be54d-7d41-4f49-9148-abd4c7da9cb5 None None] MFA Rules not processed for user `70d3373921064830869e151adb0bfb1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:56.206857 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-664be54d-7d41-4f49-9148-abd4c7da9cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:56.291712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1129/2270] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:56.298960 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c380-9f3b-479d-9d6c-ab00cce8db46 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:56.365780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c380-9f3b-479d-9d6c-ab00cce8db46 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:56.371169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e12b6f-b18d-4cb1-ab5f-f002d545c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:56.371843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e12b6f-b18d-4cb1-ab5f-f002d545c1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.372164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e12b6f-b18d-4cb1-ab5f-f002d545c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.372437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e12b6f-b18d-4cb1-ab5f-f002d545c1c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.373157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e12b6f-b18d-4cb1-ab5f-f002d545c1c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:56.375192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e12b6f-b18d-4cb1-ab5f-f002d545c1c8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:56.405627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1142/2271] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:56 2022] POST /identity/v3/projects => generated 407 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:56.415414 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664be54d-7d41-4f49-9148-abd4c7da9cb5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:56.427610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664be54d-7d41-4f49-9148-abd4c7da9cb5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:56.494842 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff052f-460e-4766-9615-aecd386b2778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:56.495718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff052f-460e-4766-9615-aecd386b2778 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.496422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff052f-460e-4766-9615-aecd386b2778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.496819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff052f-460e-4766-9615-aecd386b2778 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.497551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff052f-460e-4766-9615-aecd386b2778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:56.499605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff052f-460e-4766-9615-aecd386b2778 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:56.524251 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1130/2272] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:56 2022] POST /identity/v3/users => generated 310 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:30:56.526289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e12b6f-b18d-4cb1-ab5f-f002d545c1c8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:56.536884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e12b6f-b18d-4cb1-ab5f-f002d545c1c8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:56.542206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be060a9-4f9d-485b-82a4-d22cfd398260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:56.542926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be060a9-4f9d-485b-82a4-d22cfd398260 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.543208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be060a9-4f9d-485b-82a4-d22cfd398260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.543473 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be060a9-4f9d-485b-82a4-d22cfd398260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.544333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be060a9-4f9d-485b-82a4-d22cfd398260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:56.546286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be060a9-4f9d-485b-82a4-d22cfd398260 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:56.557360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1143/2273] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:56.563190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff052f-460e-4766-9615-aecd386b2778 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:56.574688 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff052f-460e-4766-9615-aecd386b2778 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:56.580563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad7b79-9520-48ad-bdf7-2bf25429825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:56.581505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad7b79-9520-48ad-bdf7-2bf25429825d admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.581791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad7b79-9520-48ad-bdf7-2bf25429825d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.582070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad7b79-9520-48ad-bdf7-2bf25429825d admin admin] PATH_INFO: `/v3/projects/70f431823f4c4519884cfa1022762fac/users/85352948b12849b8895d84d8da9bf1ea/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.597799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad7b79-9520-48ad-bdf7-2bf25429825d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f431823f4c4519884cfa1022762fac, user_id=85352948b12849b8895d84d8da9bf1ea, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:56.600515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad7b79-9520-48ad-bdf7-2bf25429825d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:56.615884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1131/2274] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:56 2022] PUT /identity/v3/projects/70f431823f4c4519884cfa1022762fac/users/85352948b12849b8895d84d8da9bf1ea/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:56.619987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be060a9-4f9d-485b-82a4-d22cfd398260 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:56.630343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be060a9-4f9d-485b-82a4-d22cfd398260 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:56.682684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:56.692579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6d3a7-b2f2-403d-9e7e-94a443ac3db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:56.693502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6d3a7-b2f2-403d-9e7e-94a443ac3db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.693793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6d3a7-b2f2-403d-9e7e-94a443ac3db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.694231 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6d3a7-b2f2-403d-9e7e-94a443ac3db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.695493 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6d3a7-b2f2-403d-9e7e-94a443ac3db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:56.697562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6d3a7-b2f2-403d-9e7e-94a443ac3db5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:56.709008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1144/2275] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:30:56.713402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad7b79-9520-48ad-bdf7-2bf25429825d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:56.725084 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad7b79-9520-48ad-bdf7-2bf25429825d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:56.730249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7154e6-825a-4c44-abdc-d7e71ddbd152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:56.731235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7154e6-825a-4c44-abdc-d7e71ddbd152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.731515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7154e6-825a-4c44-abdc-d7e71ddbd152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.731855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7154e6-825a-4c44-abdc-d7e71ddbd152 admin admin] PATH_INFO: `/v3/projects/70f431823f4c4519884cfa1022762fac/users/85352948b12849b8895d84d8da9bf1ea/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.734027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7154e6-825a-4c44-abdc-d7e71ddbd152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f431823f4c4519884cfa1022762fac, user_id=85352948b12849b8895d84d8da9bf1ea, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:56.736758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7154e6-825a-4c44-abdc-d7e71ddbd152 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:56.748046 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1132/2276] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:30:56 2022] PUT /identity/v3/projects/70f431823f4c4519884cfa1022762fac/users/85352948b12849b8895d84d8da9bf1ea/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:56.758237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2b42d-907e-4d15-a63b-d4d8e4a2f6a9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.758522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2b42d-907e-4d15-a63b-d4d8e4a2f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.758806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2b42d-907e-4d15-a63b-d4d8e4a2f6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.785876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-36e2b42d-907e-4d15-a63b-d4d8e4a2f6a9 None None] MFA Rules not processed for user `85352948b12849b8895d84d8da9bf1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:56.787088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-36e2b42d-907e-4d15-a63b-d4d8e4a2f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:56.861044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1145/2277] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:30:56.871905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7154e6-825a-4c44-abdc-d7e71ddbd152 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:56.873793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ac7154e6-825a-4c44-abdc-d7e71ddbd152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:56.909094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:56.943544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7154e6-825a-4c44-abdc-d7e71ddbd152 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:56.949079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f156d-819a-4899-a9c1-2d46a766f13f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:56.950249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f156d-819a-4899-a9c1-2d46a766f13f service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:56.950758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f156d-819a-4899-a9c1-2d46a766f13f service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:56.951254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f156d-819a-4899-a9c1-2d46a766f13f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:56.965478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f156d-819a-4899-a9c1-2d46a766f13f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:56.967222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f156d-819a-4899-a9c1-2d46a766f13f service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:56.979814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1133/2278] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:57.192065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2b42d-907e-4d15-a63b-d4d8e4a2f6a9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:57.193703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-36e2b42d-907e-4d15-a63b-d4d8e4a2f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:57.213574 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f156d-819a-4899-a9c1-2d46a766f13f service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:57.215988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2e1f156d-819a-4899-a9c1-2d46a766f13f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:57.246523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f156d-819a-4899-a9c1-2d46a766f13f service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:57.268933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eebced-d5ec-47e6-ba16-93283135dfff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:57.269727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eebced-d5ec-47e6-ba16-93283135dfff service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:57.271680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eebced-d5ec-47e6-ba16-93283135dfff service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:57.272466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eebced-d5ec-47e6-ba16-93283135dfff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:57.350702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2b42d-907e-4d15-a63b-d4d8e4a2f6a9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:57.357956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:57.358996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:57.359399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:57.359765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] PATH_INFO: `/v3/users/a72b12ceaeb343dc893b330875d85be6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:57.363145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72b12ceaeb343dc893b330875d85be6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:57.366857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:57.412259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eebced-d5ec-47e6-ba16-93283135dfff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:57.414553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eebced-d5ec-47e6-ba16-93283135dfff service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:57.440434 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72b12ceaeb343dc893b330875d85be6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:57.441109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72b12ceaeb343dc893b330875d85be6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:57.456963 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72b12ceaeb343dc893b330875d85be6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:57.457192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72b12ceaeb343dc893b330875d85be6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:57.466690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72b12ceaeb343dc893b330875d85be6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:57.466863 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1134/2279] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:57.470225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:57.491626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1146/2280] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:57 2022] DELETE /identity/v3/users/a72b12ceaeb343dc893b330875d85be6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:57.497587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fb73-f465-432b-b757-d6b9536d761b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:57.497884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fb73-f465-432b-b757-d6b9536d761b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:57.498173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fb73-f465-432b-b757-d6b9536d761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:57.600841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e960fb73-f465-432b-b757-d6b9536d761b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:57.602050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e960fb73-f465-432b-b757-d6b9536d761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:57.739845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1135/2281] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:57.752461 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:57.754587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:57.837463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c65cc-2c64-457b-8b9b-5b678fa24ab1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:57.842935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b05b1f-14c8-4e5f-85a1-dc0e6fc731eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:57.843918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05b1f-14c8-4e5f-85a1-dc0e6fc731eb service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:57.844496 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05b1f-14c8-4e5f-85a1-dc0e6fc731eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:57.844928 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05b1f-14c8-4e5f-85a1-dc0e6fc731eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:57.857619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b05b1f-14c8-4e5f-85a1-dc0e6fc731eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:57.861041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b05b1f-14c8-4e5f-85a1-dc0e6fc731eb service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:57.900600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1147/2282] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:58.369853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960fb73-f465-432b-b757-d6b9536d761b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:58.371687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e960fb73-f465-432b-b757-d6b9536d761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:58.385960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960fb73-f465-432b-b757-d6b9536d761b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:58.391395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:58.392620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:58.393157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:58.393653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] PATH_INFO: `/v3/projects/9464daf7da9f4365a249e8256468b2f6` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:58.395098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9464daf7da9f4365a249e8256468b2f6)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:58.397568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:58.463012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9464daf7da9f4365a249e8256468b2f6', 'request_id': 'req-56d57b3a-983a-4224-90f3-b5158a441c83'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.471045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9464daf7da9f4365a249e8256468b2f6', 'request_id': 'req-56d57b3a-983a-4224-90f3-b5158a441c83'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.479640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9464daf7da9f4365a249e8256468b2f6', 'request_id': 'req-56d57b3a-983a-4224-90f3-b5158a441c83'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.483831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:58.500648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] The token cache is being invalidate because project 9464daf7da9f4365a249e8256468b2f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:58.501019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.501757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.506408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1136/2283] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:58 2022] DELETE /identity/v3/projects/9464daf7da9f4365a249e8256468b2f6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:58.507664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b05b1f-14c8-4e5f-85a1-dc0e6fc731eb service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:58.527948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b05b1f-14c8-4e5f-85a1-dc0e6fc731eb service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:58.576570 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:58.578238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:58.614369 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:58.615272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:58.615559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:58.616198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] PATH_INFO: `/v3/users/845e0818eff645ff8d6114b5dbc25a73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:58.617397 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] RBAC: Authorizing `identity:delete_user(user_id=845e0818eff645ff8d6114b5dbc25a73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:58.619580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:58.661424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57b3a-983a-4224-90f3-b5158a441c83 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:58.667629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:58.668999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:58.669278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:58.669563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] PATH_INFO: `/v3/users/88cc556e3a67441ca7938d94f9f263e5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:58.672698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88cc556e3a67441ca7938d94f9f263e5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:58.676993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:58.703909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845e0818eff645ff8d6114b5dbc25a73'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.704728 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845e0818eff645ff8d6114b5dbc25a73'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.747034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845e0818eff645ff8d6114b5dbc25a73'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.748807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845e0818eff645ff8d6114b5dbc25a73'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.761943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88cc556e3a67441ca7938d94f9f263e5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.770891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a90f897c-f791-4e36-8bdc-24efe98affba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845e0818eff645ff8d6114b5dbc25a73'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.783098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88cc556e3a67441ca7938d94f9f263e5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.795819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88cc556e3a67441ca7938d94f9f263e5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.798109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1148/2284] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:58 2022] DELETE /identity/v3/users/845e0818eff645ff8d6114b5dbc25a73 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:58.804806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88cc556e3a67441ca7938d94f9f263e5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.806173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88cc556e3a67441ca7938d94f9f263e5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:58.820357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1137/2285] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:58 2022] DELETE /identity/v3/users/88cc556e3a67441ca7938d94f9f263e5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:30:58.824775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6b56e-7e84-4176-a316-a4f677709f86 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:58.825422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6b56e-7e84-4176-a316-a4f677709f86 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:58.825879 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6b56e-7e84-4176-a316-a4f677709f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:58.850129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-05a6b56e-7e84-4176-a316-a4f677709f86 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:58.851864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-05a6b56e-7e84-4176-a316-a4f677709f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:58.867121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:58.942798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1149/2286] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:30:58.955131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:58.957298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:59.161753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4b294-3407-4836-bb94-ebe74d8289c2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:59.169816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb4f14-cfa3-4e08-98d7-df9a34522d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:59.170505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb4f14-cfa3-4e08-98d7-df9a34522d6e service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:59.170792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb4f14-cfa3-4e08-98d7-df9a34522d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:59.171071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb4f14-cfa3-4e08-98d7-df9a34522d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:59.213312 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb4f14-cfa3-4e08-98d7-df9a34522d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:59.215052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb4f14-cfa3-4e08-98d7-df9a34522d6e service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:59.242174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1138/2287] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:30:59.251252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6b56e-7e84-4176-a316-a4f677709f86 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:59.252943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-05a6b56e-7e84-4176-a316-a4f677709f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:59.272802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6b56e-7e84-4176-a316-a4f677709f86 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:59.278836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:59.279809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:59.280282 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:59.280557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] PATH_INFO: `/v3/projects/621d4c2347d94583bfc7b4c959c47176` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:59.281967 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621d4c2347d94583bfc7b4c959c47176)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:59.284131 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:59.377178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621d4c2347d94583bfc7b4c959c47176', 'request_id': 'req-6afd01ec-9d52-4566-900b-fbfd56c4ee49'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:59.390183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621d4c2347d94583bfc7b4c959c47176', 'request_id': 'req-6afd01ec-9d52-4566-900b-fbfd56c4ee49'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:59.397887 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621d4c2347d94583bfc7b4c959c47176', 'request_id': 'req-6afd01ec-9d52-4566-900b-fbfd56c4ee49'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:59.422068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] The token cache is being invalidate because project 621d4c2347d94583bfc7b4c959c47176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:59.422460 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:59.423236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6afd01ec-9d52-4566-900b-fbfd56c4ee49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:59.426247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1150/2288] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:59 2022] DELETE /identity/v3/projects/621d4c2347d94583bfc7b4c959c47176 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:59.431545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2a959-9aad-4024-b75e-12099a4cefc4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:59.432100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2a959-9aad-4024-b75e-12099a4cefc4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:59.432307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2a959-9aad-4024-b75e-12099a4cefc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:59.480244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9ce2a959-9aad-4024-b75e-12099a4cefc4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:59.485669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9ce2a959-9aad-4024-b75e-12099a4cefc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:59.512444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:59.593556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1139/2289] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:59.601617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273eb18-f344-480d-a8db-5fafbbed8541 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:59.602184 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273eb18-f344-480d-a8db-5fafbbed8541 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:59.602184 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273eb18-f344-480d-a8db-5fafbbed8541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:59.622601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a273eb18-f344-480d-a8db-5fafbbed8541 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:30:59.623859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a273eb18-f344-480d-a8db-5fafbbed8541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:59.635560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1151/2290] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:30:59.637090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2a959-9aad-4024-b75e-12099a4cefc4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:59.648920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2a959-9aad-4024-b75e-12099a4cefc4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:59.654491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1a7ee-26e3-450d-aa94-46f93fa165ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:59.655263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1a7ee-26e3-450d-aa94-46f93fa165ba admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:59.655550 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1a7ee-26e3-450d-aa94-46f93fa165ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:59.655828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1a7ee-26e3-450d-aa94-46f93fa165ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:59.656664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1a7ee-26e3-450d-aa94-46f93fa165ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:30:59.656974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1a7ee-26e3-450d-aa94-46f93fa165ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:59.658707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1a7ee-26e3-450d-aa94-46f93fa165ba admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:59.676043 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1140/2291] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:30:59.678257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273eb18-f344-480d-a8db-5fafbbed8541 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:59.688173 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273eb18-f344-480d-a8db-5fafbbed8541 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:59.693121 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa743dc-f8c9-400c-a406-47059219c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:59.693861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa743dc-f8c9-400c-a406-47059219c97f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:59.694197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa743dc-f8c9-400c-a406-47059219c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:59.694556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa743dc-f8c9-400c-a406-47059219c97f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:59.695374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa743dc-f8c9-400c-a406-47059219c97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:59.697438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa743dc-f8c9-400c-a406-47059219c97f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:59.731163 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1152/2292] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:30:59 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:59.736030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1a7ee-26e3-450d-aa94-46f93fa165ba admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:59.743485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa743dc-f8c9-400c-a406-47059219c97f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:59.745439 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7aa743dc-f8c9-400c-a406-47059219c97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:59.748141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1a7ee-26e3-450d-aa94-46f93fa165ba admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:59.822941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61080c-aad1-4e5a-8b02-7588b52b6b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:59.823678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61080c-aad1-4e5a-8b02-7588b52b6b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:59.824047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61080c-aad1-4e5a-8b02-7588b52b6b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:59.824288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61080c-aad1-4e5a-8b02-7588b52b6b78 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:59.825015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61080c-aad1-4e5a-8b02-7588b52b6b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:59.826992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61080c-aad1-4e5a-8b02-7588b52b6b78 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:59.833275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa743dc-f8c9-400c-a406-47059219c97f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:59.839568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:59.840624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:59.840934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:59.841382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] PATH_INFO: `/v3/projects/10145bc4efc94618beb34d6f41562f91` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:59.842585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10145bc4efc94618beb34d6f41562f91)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:59.845568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:59.859065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1141/2293] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:30:59 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:30:59.859925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61080c-aad1-4e5a-8b02-7588b52b6b78 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:59.864554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:30:59.878350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61080c-aad1-4e5a-8b02-7588b52b6b78 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:59.883663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075a6aa-2dec-4f94-b7ee-8675f40a1bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:59.884459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075a6aa-2dec-4f94-b7ee-8675f40a1bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:59.884811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075a6aa-2dec-4f94-b7ee-8675f40a1bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:59.885179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075a6aa-2dec-4f94-b7ee-8675f40a1bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:59.886173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075a6aa-2dec-4f94-b7ee-8675f40a1bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:59.888271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075a6aa-2dec-4f94-b7ee-8675f40a1bbd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:30:59.903202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1142/2294] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:30:59.904853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075a6aa-2dec-4f94-b7ee-8675f40a1bbd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:59.905911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10145bc4efc94618beb34d6f41562f91', 'request_id': 'req-ffbaf64e-be0f-4a85-a425-b31467858757'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:59.915914 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10145bc4efc94618beb34d6f41562f91', 'request_id': 'req-ffbaf64e-be0f-4a85-a425-b31467858757'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:59.916429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075a6aa-2dec-4f94-b7ee-8675f40a1bbd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:30:59.929396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10145bc4efc94618beb34d6f41562f91', 'request_id': 'req-ffbaf64e-be0f-4a85-a425-b31467858757'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:59.945585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] The token cache is being invalidate because project 10145bc4efc94618beb34d6f41562f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:30:59.945955 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:59.947098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:30:59.952225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1153/2295] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:30:59 2022] DELETE /identity/v3/projects/10145bc4efc94618beb34d6f41562f91 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:30:59.954507 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:30:59.956654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:30:59.985632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79130f2-2975-4bcd-9703-6b508ceeeb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:30:59.986468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79130f2-2975-4bcd-9703-6b508ceeeb40 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:30:59.986683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79130f2-2975-4bcd-9703-6b508ceeeb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:30:59.987035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79130f2-2975-4bcd-9703-6b508ceeeb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:30:59.987784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79130f2-2975-4bcd-9703-6b508ceeeb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:30:59.989460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79130f2-2975-4bcd-9703-6b508ceeeb40 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:00.001740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1143/2296] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:00.008500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79130f2-2975-4bcd-9703-6b508ceeeb40 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:00.010709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e79130f2-2975-4bcd-9703-6b508ceeeb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:00.024305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79130f2-2975-4bcd-9703-6b508ceeeb40 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:00.028490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaf64e-be0f-4a85-a425-b31467858757 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:00.030538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842be6a-b1fe-4972-b481-76d04c544f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:00.031450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842be6a-b1fe-4972-b481-76d04c544f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:00.031734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842be6a-b1fe-4972-b481-76d04c544f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:00.032032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842be6a-b1fe-4972-b481-76d04c544f75 admin admin] PATH_INFO: `/v3/projects/9e37d22450ca4de287112487fa563163/users/e14262d9579e4e4293a2748aa894a94c/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:00.033405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:00.034292 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:00.034574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:00.035012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] PATH_INFO: `/v3/users/1a85bec82a804036abb946f7a3e9cb31` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:00.036448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a85bec82a804036abb946f7a3e9cb31)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:00.038455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:00.056724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842be6a-b1fe-4972-b481-76d04c544f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e37d22450ca4de287112487fa563163, user_id=e14262d9579e4e4293a2748aa894a94c, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:00.059519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842be6a-b1fe-4972-b481-76d04c544f75 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:00.061971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:00.085631 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1144/2297] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:00 2022] PUT /identity/v3/projects/9e37d22450ca4de287112487fa563163/users/e14262d9579e4e4293a2748aa894a94c/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:00.097394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1b928-a4cf-49e3-88ee-78eea4a376e4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:00.097682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1b928-a4cf-49e3-88ee-78eea4a376e4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:00.097961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1b928-a4cf-49e3-88ee-78eea4a376e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:00.105487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a85bec82a804036abb946f7a3e9cb31'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.108449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a85bec82a804036abb946f7a3e9cb31'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.129377 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2db1b928-a4cf-49e3-88ee-78eea4a376e4 None None] MFA Rules not processed for user `e14262d9579e4e4293a2748aa894a94c`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:00.129626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a85bec82a804036abb946f7a3e9cb31'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.130197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a85bec82a804036abb946f7a3e9cb31'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.130596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2db1b928-a4cf-49e3-88ee-78eea4a376e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:00.141657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a85bec82a804036abb946f7a3e9cb31'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.156735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1154/2298] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:30:59 2022] DELETE /identity/v3/users/1a85bec82a804036abb946f7a3e9cb31 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:00.229760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1145/2299] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:31:00.243690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:00.245169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:00.274104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:00.323701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966114c4-3234-4212-97ca-403604c6b434 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:00.332246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684955e-3003-49ae-bdd7-3740d2a4692d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:00.333191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684955e-3003-49ae-bdd7-3740d2a4692d service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:00.333568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684955e-3003-49ae-bdd7-3740d2a4692d service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:00.334245 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684955e-3003-49ae-bdd7-3740d2a4692d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:00.396189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684955e-3003-49ae-bdd7-3740d2a4692d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:00.397678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684955e-3003-49ae-bdd7-3740d2a4692d service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:00.406984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1155/2300] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:00.464491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1b928-a4cf-49e3-88ee-78eea4a376e4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:00.466138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2db1b928-a4cf-49e3-88ee-78eea4a376e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:00.546357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1b928-a4cf-49e3-88ee-78eea4a376e4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:00.612484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:00.613393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:00.613661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:00.613936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] PATH_INFO: `/v3/projects/31fabcbe0ca6498189e75f98f87edd46` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:00.615281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31fabcbe0ca6498189e75f98f87edd46)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:00.617501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:00.666384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:00.681695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fabcbe0ca6498189e75f98f87edd46', 'request_id': 'req-1c3c6397-2d01-43ef-86be-300d9dea0bf8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.701799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fabcbe0ca6498189e75f98f87edd46', 'request_id': 'req-1c3c6397-2d01-43ef-86be-300d9dea0bf8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.709085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fabcbe0ca6498189e75f98f87edd46', 'request_id': 'req-1c3c6397-2d01-43ef-86be-300d9dea0bf8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.730550 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] The token cache is being invalidate because project 31fabcbe0ca6498189e75f98f87edd46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:00.730869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.737564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.742554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1146/2301] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:00 2022] DELETE /identity/v3/projects/31fabcbe0ca6498189e75f98f87edd46 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:00.744297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684955e-3003-49ae-bdd7-3740d2a4692d service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:00.760450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684955e-3003-49ae-bdd7-3740d2a4692d service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:00.825768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:00.826556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:00.826839 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:00.827119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] PATH_INFO: `/v3/users/f5eb5872c087435a9d438bb0a2a18152` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:00.828337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5eb5872c087435a9d438bb0a2a18152)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:00.830297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:00.888765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5eb5872c087435a9d438bb0a2a18152'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.889605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5eb5872c087435a9d438bb0a2a18152'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.902587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5eb5872c087435a9d438bb0a2a18152'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.903266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5eb5872c087435a9d438bb0a2a18152'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.910247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c10b03a8-1301-41c8-acf2-07e99bd3f043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5eb5872c087435a9d438bb0a2a18152'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:00.914249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:00.927072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1156/2302] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:00 2022] DELETE /identity/v3/users/f5eb5872c087435a9d438bb0a2a18152 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:01.216275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:01.216275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:01.230152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6397-2d01-43ef-86be-300d9dea0bf8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:01.289907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:01.290788 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:01.291074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:01.291350 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] PATH_INFO: `/v3/projects/7ff35a5bc8414eb0a7da97f9acd9586e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:01.293016 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff35a5bc8414eb0a7da97f9acd9586e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:01.295056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:01.343738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff35a5bc8414eb0a7da97f9acd9586e', 'request_id': 'req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:01.349391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff35a5bc8414eb0a7da97f9acd9586e', 'request_id': 'req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:01.355734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff35a5bc8414eb0a7da97f9acd9586e', 'request_id': 'req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:01.369493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] The token cache is being invalidate because project 7ff35a5bc8414eb0a7da97f9acd9586e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:01.369784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:01.370587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-cd1c24f2-7fe8-42df-8f45-1f1c884d1197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:01.372194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1147/2303] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:01 2022] DELETE /identity/v3/projects/7ff35a5bc8414eb0a7da97f9acd9586e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:01.378083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189a8f-e957-4f79-8f55-04d10b108d62 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:01.378537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189a8f-e957-4f79-8f55-04d10b108d62 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:01.378880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189a8f-e957-4f79-8f55-04d10b108d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:01.399077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f4189a8f-e957-4f79-8f55-04d10b108d62 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:01.400352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f4189a8f-e957-4f79-8f55-04d10b108d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:01.462914 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1157/2304] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:01.471802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289711f-8acd-4887-90ae-91c246c10591 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:01.472337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289711f-8acd-4887-90ae-91c246c10591 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:01.472553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289711f-8acd-4887-90ae-91c246c10591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:01.491703 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8289711f-8acd-4887-90ae-91c246c10591 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:01.493216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8289711f-8acd-4887-90ae-91c246c10591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:01.501209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1148/2305] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:01.505477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4189a8f-e957-4f79-8f55-04d10b108d62 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:01.515658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4189a8f-e957-4f79-8f55-04d10b108d62 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:01.520594 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8731-41ab-4818-828b-13292584441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:01.521255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8731-41ab-4818-828b-13292584441c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:01.521539 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8731-41ab-4818-828b-13292584441c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:01.521813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8731-41ab-4818-828b-13292584441c admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:01.522583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8731-41ab-4818-828b-13292584441c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:31:01.522889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8731-41ab-4818-828b-13292584441c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:01.524536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8731-41ab-4818-828b-13292584441c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:01.536770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1158/2306] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:31:01.541475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289711f-8acd-4887-90ae-91c246c10591 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:01.551189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289711f-8acd-4887-90ae-91c246c10591 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:01.556089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921b7aa-01c6-472e-afba-2734920f00bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:01.556717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b7aa-01c6-472e-afba-2734920f00bd admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:01.557002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b7aa-01c6-472e-afba-2734920f00bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:01.557285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921b7aa-01c6-472e-afba-2734920f00bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:01.558041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921b7aa-01c6-472e-afba-2734920f00bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:01.559937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921b7aa-01c6-472e-afba-2734920f00bd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:01.592336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1149/2307] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:01 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:01.593587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8731-41ab-4818-828b-13292584441c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:01.604132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8731-41ab-4818-828b-13292584441c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:01.661354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bf43d-6974-443d-be64-970092bc770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:01.662064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf43d-6974-443d-be64-970092bc770f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:01.662331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf43d-6974-443d-be64-970092bc770f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:01.662604 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf43d-6974-443d-be64-970092bc770f admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:01.663308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bf43d-6974-443d-be64-970092bc770f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:01.665610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bf43d-6974-443d-be64-970092bc770f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:01.693026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1159/2308] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:01 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:31:01.697372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921b7aa-01c6-472e-afba-2734920f00bd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:01.708249 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921b7aa-01c6-472e-afba-2734920f00bd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:01.714080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa78ba-b24a-4b59-9d0c-c8450394b94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:01.714742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa78ba-b24a-4b59-9d0c-c8450394b94f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:01.715033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa78ba-b24a-4b59-9d0c-c8450394b94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:01.715311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa78ba-b24a-4b59-9d0c-c8450394b94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:01.716060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa78ba-b24a-4b59-9d0c-c8450394b94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:01.717700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa78ba-b24a-4b59-9d0c-c8450394b94f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:01.728758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1150/2309] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:01.733106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bf43d-6974-443d-be64-970092bc770f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:01.743495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bf43d-6974-443d-be64-970092bc770f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:01.749382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc22c9-fd11-44e4-bbe2-402bf8360c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:01.750087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc22c9-fd11-44e4-bbe2-402bf8360c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:01.750362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc22c9-fd11-44e4-bbe2-402bf8360c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:01.750617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc22c9-fd11-44e4-bbe2-402bf8360c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:01.751344 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc22c9-fd11-44e4-bbe2-402bf8360c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:01.752988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc22c9-fd11-44e4-bbe2-402bf8360c8f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:01.764206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1160/2310] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:01.768307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa78ba-b24a-4b59-9d0c-c8450394b94f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:01.778803 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa78ba-b24a-4b59-9d0c-c8450394b94f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:01.784034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70fb8b-6b87-4225-be74-e04dc6726bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:01.785159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70fb8b-6b87-4225-be74-e04dc6726bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:01.785159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70fb8b-6b87-4225-be74-e04dc6726bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:01.785377 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70fb8b-6b87-4225-be74-e04dc6726bd1 admin admin] PATH_INFO: `/v3/projects/513b3e97560445c8b2760e24c4719542/users/c4dc076037f544959c733dd2df07d289/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:01.794366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:01.803714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70fb8b-6b87-4225-be74-e04dc6726bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513b3e97560445c8b2760e24c4719542, user_id=c4dc076037f544959c733dd2df07d289, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:01.806933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70fb8b-6b87-4225-be74-e04dc6726bd1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:01.822189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1151/2311] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:01 2022] PUT /identity/v3/projects/513b3e97560445c8b2760e24c4719542/users/c4dc076037f544959c733dd2df07d289/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:01.833801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616bba8-c561-4ade-b7f6-0f1cc8569c10 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:01.834148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616bba8-c561-4ade-b7f6-0f1cc8569c10 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:01.834373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616bba8-c561-4ade-b7f6-0f1cc8569c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:01.861447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f616bba8-c561-4ade-b7f6-0f1cc8569c10 None None] MFA Rules not processed for user `c4dc076037f544959c733dd2df07d289`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:01.862678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f616bba8-c561-4ade-b7f6-0f1cc8569c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:01.914986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:01.933702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1161/2312] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:01.944984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70fb8b-6b87-4225-be74-e04dc6726bd1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:01.946864 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2d70fb8b-6b87-4225-be74-e04dc6726bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:02.003793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70fb8b-6b87-4225-be74-e04dc6726bd1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:02.007735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e9ede-96f3-404a-98a4-4829ae23991c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:02.008442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9ede-96f3-404a-98a4-4829ae23991c service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:02.008704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9ede-96f3-404a-98a4-4829ae23991c service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:02.008983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9ede-96f3-404a-98a4-4829ae23991c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:02.018329 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e9ede-96f3-404a-98a4-4829ae23991c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:02.019778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e9ede-96f3-404a-98a4-4829ae23991c service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:02.031470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1152/2313] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:06.026951 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051fb80-7026-40a5-a7c7-6425c2568995 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:06.027521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051fb80-7026-40a5-a7c7-6425c2568995 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:06.027521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051fb80-7026-40a5-a7c7-6425c2568995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:06.055549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a051fb80-7026-40a5-a7c7-6425c2568995 None None] MFA Rules not processed for user `e14262d9579e4e4293a2748aa894a94c`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:06.057152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a051fb80-7026-40a5-a7c7-6425c2568995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:06.133014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1162/2314] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:07.547585 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e9ede-96f3-404a-98a4-4829ae23991c service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:07.550340 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-316e9ede-96f3-404a-98a4-4829ae23991c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:07.724284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e9ede-96f3-404a-98a4-4829ae23991c service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:07.737545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:07.738880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:07.739275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:07.739567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] PATH_INFO: `/v3/users/70d3373921064830869e151adb0bfb1d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:07.750487 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d3373921064830869e151adb0bfb1d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:07.752869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:07.793861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:07.810561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d3373921064830869e151adb0bfb1d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:07.828757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d3373921064830869e151adb0bfb1d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:07.837626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d3373921064830869e151adb0bfb1d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:07.845222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d3373921064830869e151adb0bfb1d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:07.846532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d3373921064830869e151adb0bfb1d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:07.853484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1153/2315] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:07 2022] DELETE /identity/v3/users/70d3373921064830869e151adb0bfb1d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:07.860854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286439c0-7070-4342-a391-57e2a659f818 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:07.860854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286439c0-7070-4342-a391-57e2a659f818 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:07.860854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286439c0-7070-4342-a391-57e2a659f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:07.887934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-286439c0-7070-4342-a391-57e2a659f818 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:07.890093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-286439c0-7070-4342-a391-57e2a659f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:07.976485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1163/2316] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:07.988417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:07.989668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:08.192518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c029094-5aaa-4944-8f8b-06664269db02 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:08.200215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2924e-b881-46e1-82c2-c65f301a12bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:08.201615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2924e-b881-46e1-82c2-c65f301a12bd service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:08.201965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2924e-b881-46e1-82c2-c65f301a12bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:08.202894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2924e-b881-46e1-82c2-c65f301a12bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:08.219045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2924e-b881-46e1-82c2-c65f301a12bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:08.222994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2924e-b881-46e1-82c2-c65f301a12bd service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:08.237999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1154/2317] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:09.070867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286439c0-7070-4342-a391-57e2a659f818 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:09.075783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-286439c0-7070-4342-a391-57e2a659f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:09.096137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286439c0-7070-4342-a391-57e2a659f818 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:09.103909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:09.104922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:09.105216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:09.105818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] PATH_INFO: `/v3/projects/758ad81924a34c629db5394cebcb2ee7` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:09.107341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758ad81924a34c629db5394cebcb2ee7)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:09.109769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:09.180713 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758ad81924a34c629db5394cebcb2ee7', 'request_id': 'req-7a623da0-ba00-4b01-a0ea-796801b53da1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.192914 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758ad81924a34c629db5394cebcb2ee7', 'request_id': 'req-7a623da0-ba00-4b01-a0ea-796801b53da1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.202219 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758ad81924a34c629db5394cebcb2ee7', 'request_id': 'req-7a623da0-ba00-4b01-a0ea-796801b53da1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.219070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] The token cache is being invalidate because project 758ad81924a34c629db5394cebcb2ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:09.219937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.221050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.227478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1164/2318] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:09 2022] DELETE /identity/v3/projects/758ad81924a34c629db5394cebcb2ee7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:09.231552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2924e-b881-46e1-82c2-c65f301a12bd service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:09.242518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2924e-b881-46e1-82c2-c65f301a12bd service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:09.324165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:09.325207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:09.325533 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:09.325808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] PATH_INFO: `/v3/users/85352948b12849b8895d84d8da9bf1ea` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:09.327420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85352948b12849b8895d84d8da9bf1ea)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:09.329443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:09.350378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:09.383351 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85352948b12849b8895d84d8da9bf1ea'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.397170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85352948b12849b8895d84d8da9bf1ea'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.409903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85352948b12849b8895d84d8da9bf1ea'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.419012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85352948b12849b8895d84d8da9bf1ea'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.419740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6b5e35b2-b06a-4dc6-8fb8-3331ba99c8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85352948b12849b8895d84d8da9bf1ea'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.426726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1155/2319] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:09 2022] DELETE /identity/v3/users/85352948b12849b8895d84d8da9bf1ea => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:09.756604 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:09.758968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:09.777678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a623da0-ba00-4b01-a0ea-796801b53da1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:09.791170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:09.855371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:09.856411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:09.856701 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:09.856987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] PATH_INFO: `/v3/projects/70f431823f4c4519884cfa1022762fac` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:09.858199 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f431823f4c4519884cfa1022762fac)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:09.860178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:09.913897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f431823f4c4519884cfa1022762fac', 'request_id': 'req-979cec10-138e-4122-9aba-a9d1f1f5c5f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.922718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f431823f4c4519884cfa1022762fac', 'request_id': 'req-979cec10-138e-4122-9aba-a9d1f1f5c5f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.931136 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f431823f4c4519884cfa1022762fac', 'request_id': 'req-979cec10-138e-4122-9aba-a9d1f1f5c5f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.942308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] The token cache is being invalidate because project 70f431823f4c4519884cfa1022762fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:09.942711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.943399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-979cec10-138e-4122-9aba-a9d1f1f5c5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:09.944992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1165/2320] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:09 2022] DELETE /identity/v3/projects/70f431823f4c4519884cfa1022762fac => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:09.949993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036325a8-1a5d-4e1a-b68e-2055bafdb92a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:09.950406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036325a8-1a5d-4e1a-b68e-2055bafdb92a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:09.951015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036325a8-1a5d-4e1a-b68e-2055bafdb92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.003183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-036325a8-1a5d-4e1a-b68e-2055bafdb92a None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:10.005287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-036325a8-1a5d-4e1a-b68e-2055bafdb92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:10.072722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1156/2321] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:10.081969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a7c68-944f-4e45-abbb-5157c90f94dc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:10.082480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a7c68-944f-4e45-abbb-5157c90f94dc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:10.082558 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a7c68-944f-4e45-abbb-5157c90f94dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.119348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-091a7c68-944f-4e45-abbb-5157c90f94dc None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:10.120666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-091a7c68-944f-4e45-abbb-5157c90f94dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:10.132236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1166/2322] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:10.135354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036325a8-1a5d-4e1a-b68e-2055bafdb92a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:10.147461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036325a8-1a5d-4e1a-b68e-2055bafdb92a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:10.157259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f9ccd-7723-4338-8390-ca93cec3f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:10.157963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9ccd-7723-4338-8390-ca93cec3f514 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:10.160372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9ccd-7723-4338-8390-ca93cec3f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:10.160890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f9ccd-7723-4338-8390-ca93cec3f514 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.161881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f9ccd-7723-4338-8390-ca93cec3f514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:31:10.162413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f9ccd-7723-4338-8390-ca93cec3f514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:10.164800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f9ccd-7723-4338-8390-ca93cec3f514 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:10.183769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1157/2323] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:31:10.185094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a7c68-944f-4e45-abbb-5157c90f94dc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:10.196876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a7c68-944f-4e45-abbb-5157c90f94dc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:10.201954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba7ced-64b3-4197-a795-af9ab138c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:10.202705 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba7ced-64b3-4197-a795-af9ab138c422 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:10.203058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba7ced-64b3-4197-a795-af9ab138c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:10.203405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba7ced-64b3-4197-a795-af9ab138c422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.204232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba7ced-64b3-4197-a795-af9ab138c422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:10.216411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba7ced-64b3-4197-a795-af9ab138c422 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:10.237038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1167/2324] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:10 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:31:10.242489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f9ccd-7723-4338-8390-ca93cec3f514 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:10.257068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f9ccd-7723-4338-8390-ca93cec3f514 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:10.350125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893072-61a2-4f0d-8a80-d74c1c4cce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:10.351064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893072-61a2-4f0d-8a80-d74c1c4cce72 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:10.351499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893072-61a2-4f0d-8a80-d74c1c4cce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:10.351923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893072-61a2-4f0d-8a80-d74c1c4cce72 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.352871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7893072-61a2-4f0d-8a80-d74c1c4cce72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:10.355049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7893072-61a2-4f0d-8a80-d74c1c4cce72 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:10.365837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:10.394525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1158/2325] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:10 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:10.395588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba7ced-64b3-4197-a795-af9ab138c422 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:10.410856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba7ced-64b3-4197-a795-af9ab138c422 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:10.430495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cbd0d-8761-44fc-a24f-073cfb41eaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:10.431188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cbd0d-8761-44fc-a24f-073cfb41eaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:10.431691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cbd0d-8761-44fc-a24f-073cfb41eaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:10.432106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cbd0d-8761-44fc-a24f-073cfb41eaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.433684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cbd0d-8761-44fc-a24f-073cfb41eaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:10.435380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cbd0d-8761-44fc-a24f-073cfb41eaa7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:10.458698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1168/2326] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:31:10.460218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893072-61a2-4f0d-8a80-d74c1c4cce72 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:10.476252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893072-61a2-4f0d-8a80-d74c1c4cce72 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:10.477003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ffe25-fd42-4ae1-8130-3505f9c2077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:10.477830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ffe25-fd42-4ae1-8130-3505f9c2077b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:10.478119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ffe25-fd42-4ae1-8130-3505f9c2077b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:10.478397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ffe25-fd42-4ae1-8130-3505f9c2077b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.479138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ffe25-fd42-4ae1-8130-3505f9c2077b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:10.480814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ffe25-fd42-4ae1-8130-3505f9c2077b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:10.499283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1159/2327] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:10.500223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cbd0d-8761-44fc-a24f-073cfb41eaa7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:10.516858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cbd0d-8761-44fc-a24f-073cfb41eaa7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:10.522920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf986e8-d357-4029-8a30-823ec50b400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:10.524211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf986e8-d357-4029-8a30-823ec50b400d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:10.524666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf986e8-d357-4029-8a30-823ec50b400d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:10.525421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf986e8-d357-4029-8a30-823ec50b400d admin admin] PATH_INFO: `/v3/projects/c44d83e99c174f4984ee46ecb997752c/users/86be957ffc334c7f98f9b7badb45a16a/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.548549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf986e8-d357-4029-8a30-823ec50b400d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44d83e99c174f4984ee46ecb997752c, user_id=86be957ffc334c7f98f9b7badb45a16a, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:10.551555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf986e8-d357-4029-8a30-823ec50b400d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:10.584149 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1169/2328] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:10 2022] PUT /identity/v3/projects/c44d83e99c174f4984ee46ecb997752c/users/86be957ffc334c7f98f9b7badb45a16a/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:10.595388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c79435-62ec-403d-986e-a6f34a24b234 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:10.595851 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c79435-62ec-403d-986e-a6f34a24b234 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:10.596134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c79435-62ec-403d-986e-a6f34a24b234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.635975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-39c79435-62ec-403d-986e-a6f34a24b234 None None] MFA Rules not processed for user `86be957ffc334c7f98f9b7badb45a16a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:10.637768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-39c79435-62ec-403d-986e-a6f34a24b234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:10.751076 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1160/2329] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:10.761238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf986e8-d357-4029-8a30-823ec50b400d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:10.821126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:10.849275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf986e8-d357-4029-8a30-823ec50b400d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:10.854166 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f784c-58d4-43ea-b145-49cbdfda234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:10.854678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f784c-58d4-43ea-b145-49cbdfda234d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:10.854961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f784c-58d4-43ea-b145-49cbdfda234d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:10.855237 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f784c-58d4-43ea-b145-49cbdfda234d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.855945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f784c-58d4-43ea-b145-49cbdfda234d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:10.857918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f784c-58d4-43ea-b145-49cbdfda234d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:10.894411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1170/2330] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:10 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:10.895510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c79435-62ec-403d-986e-a6f34a24b234 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:10.908669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c79435-62ec-403d-986e-a6f34a24b234 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:10.979595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb329cf-36b0-4e52-bb41-5d537de52aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:10.980338 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb329cf-36b0-4e52-bb41-5d537de52aea admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:10.980620 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb329cf-36b0-4e52-bb41-5d537de52aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:10.980895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb329cf-36b0-4e52-bb41-5d537de52aea admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:10.981952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb329cf-36b0-4e52-bb41-5d537de52aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:10.984944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb329cf-36b0-4e52-bb41-5d537de52aea admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:11.015387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1161/2331] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:10 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:11.016860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f784c-58d4-43ea-b145-49cbdfda234d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:11.031596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f784c-58d4-43ea-b145-49cbdfda234d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:11.038105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea7f6d-fc30-4552-a6e5-cd9d1f9ffd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:11.039236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea7f6d-fc30-4552-a6e5-cd9d1f9ffd08 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:11.039593 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea7f6d-fc30-4552-a6e5-cd9d1f9ffd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:11.039941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea7f6d-fc30-4552-a6e5-cd9d1f9ffd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:11.040908 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea7f6d-fc30-4552-a6e5-cd9d1f9ffd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:11.042623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea7f6d-fc30-4552-a6e5-cd9d1f9ffd08 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:11.056489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1171/2332] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:11.061395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb329cf-36b0-4e52-bb41-5d537de52aea admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:11.076592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb329cf-36b0-4e52-bb41-5d537de52aea admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:11.091992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99778bea-07fd-4d93-822d-2cb51b1b7ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:11.092952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99778bea-07fd-4d93-822d-2cb51b1b7ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:11.093243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99778bea-07fd-4d93-822d-2cb51b1b7ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:11.093626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99778bea-07fd-4d93-822d-2cb51b1b7ba9 admin admin] PATH_INFO: `/v3/projects/457ecf45e4d445b583f92cd8cfc864c5/users/95f1fa2487da4f82abf12814b4137265/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:11.112904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99778bea-07fd-4d93-822d-2cb51b1b7ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=457ecf45e4d445b583f92cd8cfc864c5, user_id=95f1fa2487da4f82abf12814b4137265, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:11.115625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99778bea-07fd-4d93-822d-2cb51b1b7ba9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:11.137948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1162/2333] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:11 2022] PUT /identity/v3/projects/457ecf45e4d445b583f92cd8cfc864c5/users/95f1fa2487da4f82abf12814b4137265/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:11.142580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea7f6d-fc30-4552-a6e5-cd9d1f9ffd08 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:11.155240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea7f6d-fc30-4552-a6e5-cd9d1f9ffd08 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:11.268257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfa26c-3733-4ddb-aed3-ef8381cc8b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:11.269129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfa26c-3733-4ddb-aed3-ef8381cc8b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:11.269788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfa26c-3733-4ddb-aed3-ef8381cc8b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:11.271900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfa26c-3733-4ddb-aed3-ef8381cc8b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:11.272922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfa26c-3733-4ddb-aed3-ef8381cc8b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:11.279013 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfa26c-3733-4ddb-aed3-ef8381cc8b2f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:11.302279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1172/2334] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:31:11.304737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99778bea-07fd-4d93-822d-2cb51b1b7ba9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:11.333070 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99778bea-07fd-4d93-822d-2cb51b1b7ba9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:11.343000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee8afc-4d65-4a69-9ebe-8a59cd40b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:11.343924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8afc-4d65-4a69-9ebe-8a59cd40b857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:11.344238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8afc-4d65-4a69-9ebe-8a59cd40b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:11.344516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee8afc-4d65-4a69-9ebe-8a59cd40b857 admin admin] PATH_INFO: `/v3/projects/457ecf45e4d445b583f92cd8cfc864c5/users/95f1fa2487da4f82abf12814b4137265/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:11.351639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee8afc-4d65-4a69-9ebe-8a59cd40b857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=457ecf45e4d445b583f92cd8cfc864c5, user_id=95f1fa2487da4f82abf12814b4137265, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:11.354639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee8afc-4d65-4a69-9ebe-8a59cd40b857 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:11.379018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1163/2335] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:11 2022] PUT /identity/v3/projects/457ecf45e4d445b583f92cd8cfc864c5/users/95f1fa2487da4f82abf12814b4137265/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:11.392477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a6406-d191-4ced-b1a4-f95ef9ca6651 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:11.393017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a6406-d191-4ced-b1a4-f95ef9ca6651 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:11.393525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a6406-d191-4ced-b1a4-f95ef9ca6651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:11.437488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-124a6406-d191-4ced-b1a4-f95ef9ca6651 None None] MFA Rules not processed for user `95f1fa2487da4f82abf12814b4137265`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:11.439161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-124a6406-d191-4ced-b1a4-f95ef9ca6651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:11.551147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1173/2336] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:11.555716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee8afc-4d65-4a69-9ebe-8a59cd40b857 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:11.557512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d9ee8afc-4d65-4a69-9ebe-8a59cd40b857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:11.593277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:11.626712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee8afc-4d65-4a69-9ebe-8a59cd40b857 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:11.630736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1b172-2e26-45f1-b55e-f0646e4b23db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:11.631440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1b172-2e26-45f1-b55e-f0646e4b23db service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:11.631682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1b172-2e26-45f1-b55e-f0646e4b23db service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:11.632042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1b172-2e26-45f1-b55e-f0646e4b23db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:11.646200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1b172-2e26-45f1-b55e-f0646e4b23db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:11.650262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1b172-2e26-45f1-b55e-f0646e4b23db service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:11.663051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1164/2337] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:12.582265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a6406-d191-4ced-b1a4-f95ef9ca6651 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:12.636045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:12.672850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a6406-d191-4ced-b1a4-f95ef9ca6651 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:12.677893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:12.679827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:12.680477 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:12.681039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] PATH_INFO: `/v3/users/86be957ffc334c7f98f9b7badb45a16a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:12.686458 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86be957ffc334c7f98f9b7badb45a16a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:12.692056 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:12.769587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86be957ffc334c7f98f9b7badb45a16a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:12.770277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86be957ffc334c7f98f9b7badb45a16a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:12.787364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86be957ffc334c7f98f9b7badb45a16a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:12.788938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86be957ffc334c7f98f9b7badb45a16a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:12.799016 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86be957ffc334c7f98f9b7badb45a16a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:12.822497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1174/2338] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:12 2022] DELETE /identity/v3/users/86be957ffc334c7f98f9b7badb45a16a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:12.827218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b465f-de68-49b7-8848-2671ef60a7bc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:12.827694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b465f-de68-49b7-8848-2671ef60a7bc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:12.827966 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b465f-de68-49b7-8848-2671ef60a7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:12.855576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fd0b465f-de68-49b7-8848-2671ef60a7bc None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:12.856686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fd0b465f-de68-49b7-8848-2671ef60a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:12.928808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1165/2339] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:12.939143 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:12.941819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:13.012382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0fa7-8c81-4e9d-b96f-59b399317d88 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:13.017003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e749be9-e0ee-4e73-aa9f-b2feafb42048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:13.017758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e749be9-e0ee-4e73-aa9f-b2feafb42048 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:13.018063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e749be9-e0ee-4e73-aa9f-b2feafb42048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:13.018348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e749be9-e0ee-4e73-aa9f-b2feafb42048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:13.031803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e749be9-e0ee-4e73-aa9f-b2feafb42048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:13.031803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e749be9-e0ee-4e73-aa9f-b2feafb42048 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:13.041926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1175/2340] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:13.386254 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b465f-de68-49b7-8848-2671ef60a7bc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:13.387699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fd0b465f-de68-49b7-8848-2671ef60a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:13.400672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b465f-de68-49b7-8848-2671ef60a7bc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:13.406969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:13.408334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:13.408819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:13.409188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] PATH_INFO: `/v3/projects/c44d83e99c174f4984ee46ecb997752c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:13.410696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44d83e99c174f4984ee46ecb997752c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:13.413307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:13.471072 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44d83e99c174f4984ee46ecb997752c', 'request_id': 'req-770f58c7-d05b-462c-9024-d6d1c9c6f47c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:13.476642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44d83e99c174f4984ee46ecb997752c', 'request_id': 'req-770f58c7-d05b-462c-9024-d6d1c9c6f47c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:13.482889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44d83e99c174f4984ee46ecb997752c', 'request_id': 'req-770f58c7-d05b-462c-9024-d6d1c9c6f47c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:13.497521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] The token cache is being invalidate because project c44d83e99c174f4984ee46ecb997752c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:13.497834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:13.498475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:13.500569 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1166/2341] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:13 2022] DELETE /identity/v3/projects/c44d83e99c174f4984ee46ecb997752c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:13.504743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e749be9-e0ee-4e73-aa9f-b2feafb42048 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:13.514772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e749be9-e0ee-4e73-aa9f-b2feafb42048 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:13.571799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:13.579241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:13.580513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:13.580803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:13.581090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] PATH_INFO: `/v3/users/95f1fa2487da4f82abf12814b4137265` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:13.582638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f1fa2487da4f82abf12814b4137265)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:13.584799 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:13.640597 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f1fa2487da4f82abf12814b4137265'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:13.641153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f1fa2487da4f82abf12814b4137265'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:13.654406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f1fa2487da4f82abf12814b4137265'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:13.655188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f1fa2487da4f82abf12814b4137265'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:13.662736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cdbcec73-0875-46c7-8979-ce83dfdb68f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f1fa2487da4f82abf12814b4137265'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:13.681386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1176/2342] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:13 2022] DELETE /identity/v3/users/95f1fa2487da4f82abf12814b4137265 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:13.994623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:13.996396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:14.011902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f58c7-d05b-462c-9024-d6d1c9c6f47c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:14.077982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:14.092702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:14.093991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.094648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.095131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] PATH_INFO: `/v3/projects/457ecf45e4d445b583f92cd8cfc864c5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.097429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457ecf45e4d445b583f92cd8cfc864c5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:14.099699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:14.164175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457ecf45e4d445b583f92cd8cfc864c5', 'request_id': 'req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:14.172140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457ecf45e4d445b583f92cd8cfc864c5', 'request_id': 'req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:14.180874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457ecf45e4d445b583f92cd8cfc864c5', 'request_id': 'req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:14.200937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] The token cache is being invalidate because project 457ecf45e4d445b583f92cd8cfc864c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:14.201316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:14.202198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff5ca8f7-06dd-4bca-85f7-b715dcac8646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:14.204553 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1167/2343] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:13 2022] DELETE /identity/v3/projects/457ecf45e4d445b583f92cd8cfc864c5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:14.211082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c2b0-ff6e-44a5-8cf1-7d385bd67ecc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.211384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c2b0-ff6e-44a5-8cf1-7d385bd67ecc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.211825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c2b0-ff6e-44a5-8cf1-7d385bd67ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.255297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6d84c2b0-ff6e-44a5-8cf1-7d385bd67ecc None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:14.256983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6d84c2b0-ff6e-44a5-8cf1-7d385bd67ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:14.340540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1177/2344] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:14.351484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17cecb-3aea-4e71-9b6d-62ae8126e570 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.351782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17cecb-3aea-4e71-9b6d-62ae8126e570 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.352171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17cecb-3aea-4e71-9b6d-62ae8126e570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.372173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7b17cecb-3aea-4e71-9b6d-62ae8126e570 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:14.373917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7b17cecb-3aea-4e71-9b6d-62ae8126e570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:14.382983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1168/2345] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:14.387601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84c2b0-ff6e-44a5-8cf1-7d385bd67ecc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:14.398805 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84c2b0-ff6e-44a5-8cf1-7d385bd67ecc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:14.406506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb8de7-9278-428e-8749-080b18fdec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:14.407473 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb8de7-9278-428e-8749-080b18fdec0e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.407780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb8de7-9278-428e-8749-080b18fdec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.408357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb8de7-9278-428e-8749-080b18fdec0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.409616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb8de7-9278-428e-8749-080b18fdec0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:31:14.410525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb8de7-9278-428e-8749-080b18fdec0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:14.415258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb8de7-9278-428e-8749-080b18fdec0e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:14.434167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1178/2346] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:31:14.438947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17cecb-3aea-4e71-9b6d-62ae8126e570 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:14.452881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17cecb-3aea-4e71-9b6d-62ae8126e570 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:14.458506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d7ae5-b1fa-425f-916c-3a0f99c515df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:14.459174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7ae5-b1fa-425f-916c-3a0f99c515df admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.459452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7ae5-b1fa-425f-916c-3a0f99c515df admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.459724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7ae5-b1fa-425f-916c-3a0f99c515df admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.460484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d7ae5-b1fa-425f-916c-3a0f99c515df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:14.462485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d7ae5-b1fa-425f-916c-3a0f99c515df admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:14.493848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1169/2347] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:14 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:14.499977 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb8de7-9278-428e-8749-080b18fdec0e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:14.513870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb8de7-9278-428e-8749-080b18fdec0e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:14.589599 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb34fc-0b32-4bdb-8647-f404b5bb1dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:14.590276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb34fc-0b32-4bdb-8647-f404b5bb1dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.590534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb34fc-0b32-4bdb-8647-f404b5bb1dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.590806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb34fc-0b32-4bdb-8647-f404b5bb1dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.591512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb34fc-0b32-4bdb-8647-f404b5bb1dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:14.593467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb34fc-0b32-4bdb-8647-f404b5bb1dd5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:14.602545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:14.620512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1179/2348] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:14 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:31:14.624977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d7ae5-b1fa-425f-916c-3a0f99c515df admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:14.635989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d7ae5-b1fa-425f-916c-3a0f99c515df admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:14.641001 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add0b5-2269-4afc-a41a-b8b66dcf1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:14.641661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add0b5-2269-4afc-a41a-b8b66dcf1b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.641944 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add0b5-2269-4afc-a41a-b8b66dcf1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.642213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add0b5-2269-4afc-a41a-b8b66dcf1b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.643047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48add0b5-2269-4afc-a41a-b8b66dcf1b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:14.644726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48add0b5-2269-4afc-a41a-b8b66dcf1b75 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:14.655660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1170/2349] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:14.659913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb34fc-0b32-4bdb-8647-f404b5bb1dd5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:14.670941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb34fc-0b32-4bdb-8647-f404b5bb1dd5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:14.676616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32014f4-86ca-44c5-83c8-2a16a6646016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:14.677293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32014f4-86ca-44c5-83c8-2a16a6646016 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.677560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32014f4-86ca-44c5-83c8-2a16a6646016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.677859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32014f4-86ca-44c5-83c8-2a16a6646016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.678592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32014f4-86ca-44c5-83c8-2a16a6646016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:14.680226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32014f4-86ca-44c5-83c8-2a16a6646016 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:14.691335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1180/2350] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:31:14.695622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add0b5-2269-4afc-a41a-b8b66dcf1b75 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:14.705778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add0b5-2269-4afc-a41a-b8b66dcf1b75 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:14.710892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59dba6-abca-48d9-9252-2f838c3cfada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:14.711787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59dba6-abca-48d9-9252-2f838c3cfada admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.712094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59dba6-abca-48d9-9252-2f838c3cfada admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.712369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59dba6-abca-48d9-9252-2f838c3cfada admin admin] PATH_INFO: `/v3/projects/525dc99fe33b4832ac8c77f3a890e2c7/users/de652e2d9ee140eeb7166bbaff75ce02/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.732920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59dba6-abca-48d9-9252-2f838c3cfada admin admin] RBAC: Authorizing `identity:create_grant(project_id=525dc99fe33b4832ac8c77f3a890e2c7, user_id=de652e2d9ee140eeb7166bbaff75ce02, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:14.735565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59dba6-abca-48d9-9252-2f838c3cfada admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:14.752166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1171/2351] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:14 2022] PUT /identity/v3/projects/525dc99fe33b4832ac8c77f3a890e2c7/users/de652e2d9ee140eeb7166bbaff75ce02/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:14.762489 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46415f67-4f50-4f81-bdcc-274296cc4739 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.762808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46415f67-4f50-4f81-bdcc-274296cc4739 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.763089 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46415f67-4f50-4f81-bdcc-274296cc4739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.791020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-46415f67-4f50-4f81-bdcc-274296cc4739 None None] MFA Rules not processed for user `de652e2d9ee140eeb7166bbaff75ce02`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:14.792247 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-46415f67-4f50-4f81-bdcc-274296cc4739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:14.860450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1181/2352] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:14.865265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59dba6-abca-48d9-9252-2f838c3cfada admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:14.934646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59dba6-abca-48d9-9252-2f838c3cfada admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:14.941385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4d5f5-2898-4ac4-a9a4-59d515d2e34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:14.942366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4d5f5-2898-4ac4-a9a4-59d515d2e34c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:14.942770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4d5f5-2898-4ac4-a9a4-59d515d2e34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:14.943140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4d5f5-2898-4ac4-a9a4-59d515d2e34c admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:14.943928 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4d5f5-2898-4ac4-a9a4-59d515d2e34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:14.946141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4d5f5-2898-4ac4-a9a4-59d515d2e34c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:14.976277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1172/2353] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:14 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:14.979964 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46415f67-4f50-4f81-bdcc-274296cc4739 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:14.993555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46415f67-4f50-4f81-bdcc-274296cc4739 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:15.055769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949d86e-aa96-4221-b7f2-4dbeed1c3913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:15.056471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949d86e-aa96-4221-b7f2-4dbeed1c3913 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:15.056806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949d86e-aa96-4221-b7f2-4dbeed1c3913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:15.057087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949d86e-aa96-4221-b7f2-4dbeed1c3913 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:15.057803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949d86e-aa96-4221-b7f2-4dbeed1c3913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:15.059740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949d86e-aa96-4221-b7f2-4dbeed1c3913 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:15.082952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1182/2354] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:14 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:15.088488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4d5f5-2898-4ac4-a9a4-59d515d2e34c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:15.095945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:15.099518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4d5f5-2898-4ac4-a9a4-59d515d2e34c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:15.105107 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a017e-0ee7-4445-b794-db1095f6562e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:15.105772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a017e-0ee7-4445-b794-db1095f6562e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:15.106045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a017e-0ee7-4445-b794-db1095f6562e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:15.106333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a017e-0ee7-4445-b794-db1095f6562e admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:15.107427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a017e-0ee7-4445-b794-db1095f6562e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:15.109167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a017e-0ee7-4445-b794-db1095f6562e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:15.120181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1173/2355] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:15.124415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949d86e-aa96-4221-b7f2-4dbeed1c3913 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:15.134868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949d86e-aa96-4221-b7f2-4dbeed1c3913 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:15.139618 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afd880-6016-4799-8d7a-485a1c0981a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:15.140544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd880-6016-4799-8d7a-485a1c0981a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:15.140823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd880-6016-4799-8d7a-485a1c0981a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:15.141103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd880-6016-4799-8d7a-485a1c0981a9 admin admin] PATH_INFO: `/v3/projects/ce08b81972444c168e5d7ade14c5d8e9/users/5f0808fdb7914e068da8d7c21d14ff9f/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:15.156388 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afd880-6016-4799-8d7a-485a1c0981a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce08b81972444c168e5d7ade14c5d8e9, user_id=5f0808fdb7914e068da8d7c21d14ff9f, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:15.159287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afd880-6016-4799-8d7a-485a1c0981a9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:15.176935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1183/2356] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:15 2022] PUT /identity/v3/projects/ce08b81972444c168e5d7ade14c5d8e9/users/5f0808fdb7914e068da8d7c21d14ff9f/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:15.181041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a017e-0ee7-4445-b794-db1095f6562e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:15.191883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a017e-0ee7-4445-b794-db1095f6562e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:15.248998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb8b6-3cd0-4c08-8694-cca6c5b97459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:15.249671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb8b6-3cd0-4c08-8694-cca6c5b97459 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:15.249954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb8b6-3cd0-4c08-8694-cca6c5b97459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:15.250230 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb8b6-3cd0-4c08-8694-cca6c5b97459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:15.250957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcb8b6-3cd0-4c08-8694-cca6c5b97459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:15.253030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcb8b6-3cd0-4c08-8694-cca6c5b97459 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:15.262744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1174/2357] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:15.267012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afd880-6016-4799-8d7a-485a1c0981a9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:15.278021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afd880-6016-4799-8d7a-485a1c0981a9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:15.283722 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1fe0-03e6-4bee-aa06-528765a4b43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:15.284702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1fe0-03e6-4bee-aa06-528765a4b43b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:15.284983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1fe0-03e6-4bee-aa06-528765a4b43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:15.285257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1fe0-03e6-4bee-aa06-528765a4b43b admin admin] PATH_INFO: `/v3/projects/ce08b81972444c168e5d7ade14c5d8e9/users/5f0808fdb7914e068da8d7c21d14ff9f/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:15.287341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d1fe0-03e6-4bee-aa06-528765a4b43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce08b81972444c168e5d7ade14c5d8e9, user_id=5f0808fdb7914e068da8d7c21d14ff9f, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:15.290497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d1fe0-03e6-4bee-aa06-528765a4b43b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:15.301700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1184/2358] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:15 2022] PUT /identity/v3/projects/ce08b81972444c168e5d7ade14c5d8e9/users/5f0808fdb7914e068da8d7c21d14ff9f/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:15.312918 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ba97-64f1-4b30-862d-8fab46abf7c7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:15.313509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ba97-64f1-4b30-862d-8fab46abf7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:15.313811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ba97-64f1-4b30-862d-8fab46abf7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:15.344834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8362ba97-64f1-4b30-862d-8fab46abf7c7 None None] MFA Rules not processed for user `5f0808fdb7914e068da8d7c21d14ff9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:15.347267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8362ba97-64f1-4b30-862d-8fab46abf7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:15.436806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1175/2359] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:15.449442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1fe0-03e6-4bee-aa06-528765a4b43b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:15.451197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ed9d1fe0-03e6-4bee-aa06-528765a4b43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:15.482795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:15.524346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1fe0-03e6-4bee-aa06-528765a4b43b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:15.527780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b3f68-ce71-4e54-99f4-ac7b301188b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:15.528528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b3f68-ce71-4e54-99f4-ac7b301188b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:15.528985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b3f68-ce71-4e54-99f4-ac7b301188b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:15.529351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b3f68-ce71-4e54-99f4-ac7b301188b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:15.541085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b3f68-ce71-4e54-99f4-ac7b301188b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:15.542727 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b3f68-ce71-4e54-99f4-ac7b301188b0 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:15.557995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1185/2360] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:15.632403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362ba97-64f1-4b30-862d-8fab46abf7c7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:15.642471 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362ba97-64f1-4b30-862d-8fab46abf7c7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:15.647243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541e5ee-e8dd-4c2a-a741-5780d8c0ff4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:15.648129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e5ee-e8dd-4c2a-a741-5780d8c0ff4d service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:15.648336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e5ee-e8dd-4c2a-a741-5780d8c0ff4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:15.648617 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e5ee-e8dd-4c2a-a741-5780d8c0ff4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:15.710320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541e5ee-e8dd-4c2a-a741-5780d8c0ff4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:15.711736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541e5ee-e8dd-4c2a-a741-5780d8c0ff4d service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:15.721599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1176/2361] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:15.994277 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b3f68-ce71-4e54-99f4-ac7b301188b0 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:16.074420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541e5ee-e8dd-4c2a-a741-5780d8c0ff4d service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:16.075904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2541e5ee-e8dd-4c2a-a741-5780d8c0ff4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:16.082559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b3f68-ce71-4e54-99f4-ac7b301188b0 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:16.087151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:16.088382 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:16.088702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:16.089435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] PATH_INFO: `/v3/users/de652e2d9ee140eeb7166bbaff75ce02` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:16.090747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de652e2d9ee140eeb7166bbaff75ce02)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:16.091501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541e5ee-e8dd-4c2a-a741-5780d8c0ff4d service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:16.092631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:16.097110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:16.098100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:16.098343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:16.099221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] PATH_INFO: `/v3/users/c4dc076037f544959c733dd2df07d289` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:16.099763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4dc076037f544959c733dd2df07d289)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:16.101775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:16.108603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:16.152433 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de652e2d9ee140eeb7166bbaff75ce02'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:16.152724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de652e2d9ee140eeb7166bbaff75ce02'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:16.165782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4dc076037f544959c733dd2df07d289'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:16.175773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de652e2d9ee140eeb7166bbaff75ce02'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:16.176775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de652e2d9ee140eeb7166bbaff75ce02'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:16.186887 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8c3eaa30-445f-499a-ae38-24877acb6f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de652e2d9ee140eeb7166bbaff75ce02'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:16.188903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4dc076037f544959c733dd2df07d289'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:16.206372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4dc076037f544959c733dd2df07d289'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:16.218169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1186/2362] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:15 2022] DELETE /identity/v3/users/de652e2d9ee140eeb7166bbaff75ce02 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:16.218387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4dc076037f544959c733dd2df07d289'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:16.218387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-635f954d-878b-4dd3-a45b-dcaecb2651cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4dc076037f544959c733dd2df07d289'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:16.220326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1eaf0-6ac9-45e0-8ee9-c6b665f4f6cd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:16.220830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1eaf0-6ac9-45e0-8ee9-c6b665f4f6cd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:16.221495 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1eaf0-6ac9-45e0-8ee9-c6b665f4f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:16.237565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1177/2363] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:16 2022] DELETE /identity/v3/users/c4dc076037f544959c733dd2df07d289 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:16.239340 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb63adb-69b0-4423-9738-4d93c023d670 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:16.239631 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb63adb-69b0-4423-9738-4d93c023d670 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:16.239909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb63adb-69b0-4423-9738-4d93c023d670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:16.242287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-76f1eaf0-6ac9-45e0-8ee9-c6b665f4f6cd None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:16.243578 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-76f1eaf0-6ac9-45e0-8ee9-c6b665f4f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:16.259262 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bbb63adb-69b0-4423-9738-4d93c023d670 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:16.260510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bbb63adb-69b0-4423-9738-4d93c023d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:16.291243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:16.315596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1187/2364] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:16.328306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1eaf0-6ac9-45e0-8ee9-c6b665f4f6cd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:16.329782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-76f1eaf0-6ac9-45e0-8ee9-c6b665f4f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:16.334002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1178/2365] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:16.343727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb63adb-69b0-4423-9738-4d93c023d670 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:16.345638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bbb63adb-69b0-4423-9738-4d93c023d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:16.399412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1eaf0-6ac9-45e0-8ee9-c6b665f4f6cd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:16.403141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46947344-0e01-4400-aa0e-e3090176f72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:16.404147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46947344-0e01-4400-aa0e-e3090176f72f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:16.404147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46947344-0e01-4400-aa0e-e3090176f72f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:16.404386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46947344-0e01-4400-aa0e-e3090176f72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:16.408050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb63adb-69b0-4423-9738-4d93c023d670 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:16.412190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a74a9d-64eb-462f-b94c-020fb0cb9065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:16.412947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a74a9d-64eb-462f-b94c-020fb0cb9065 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:16.413372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a74a9d-64eb-462f-b94c-020fb0cb9065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:16.414059 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a74a9d-64eb-462f-b94c-020fb0cb9065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:16.415524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46947344-0e01-4400-aa0e-e3090176f72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:16.417027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46947344-0e01-4400-aa0e-e3090176f72f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:16.424693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a74a9d-64eb-462f-b94c-020fb0cb9065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:16.426441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a74a9d-64eb-462f-b94c-020fb0cb9065 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:16.429086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1188/2366] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:31:16.437760 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1179/2367] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:31:16.995766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46947344-0e01-4400-aa0e-e3090176f72f service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:16.997201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-46947344-0e01-4400-aa0e-e3090176f72f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.007729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a74a9d-64eb-462f-b94c-020fb0cb9065 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:17.009773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-27a74a9d-64eb-462f-b94c-020fb0cb9065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.010893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46947344-0e01-4400-aa0e-e3090176f72f service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.016902 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.017524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.018012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.018380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] PATH_INFO: `/v3/projects/525dc99fe33b4832ac8c77f3a890e2c7` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.019641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=525dc99fe33b4832ac8c77f3a890e2c7)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:17.021876 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:17.025924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a74a9d-64eb-462f-b94c-020fb0cb9065 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.031378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.032328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.032618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.032931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] PATH_INFO: `/v3/projects/513b3e97560445c8b2760e24c4719542` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.034396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=513b3e97560445c8b2760e24c4719542)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:17.036461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:17.066474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:17.079251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525dc99fe33b4832ac8c77f3a890e2c7', 'request_id': 'req-904efa49-75e8-411c-bfa8-d2e71f9382d3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.088404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525dc99fe33b4832ac8c77f3a890e2c7', 'request_id': 'req-904efa49-75e8-411c-bfa8-d2e71f9382d3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.097730 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525dc99fe33b4832ac8c77f3a890e2c7', 'request_id': 'req-904efa49-75e8-411c-bfa8-d2e71f9382d3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.098871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513b3e97560445c8b2760e24c4719542', 'request_id': 'req-07fcc845-484b-4461-a7dd-3c63ece112a4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.105421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513b3e97560445c8b2760e24c4719542', 'request_id': 'req-07fcc845-484b-4461-a7dd-3c63ece112a4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.112302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513b3e97560445c8b2760e24c4719542', 'request_id': 'req-07fcc845-484b-4461-a7dd-3c63ece112a4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.122130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] The token cache is being invalidate because project 525dc99fe33b4832ac8c77f3a890e2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:17.122535 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.123065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.124666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1189/2368] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:16 2022] DELETE /identity/v3/projects/525dc99fe33b4832ac8c77f3a890e2c7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:17.127020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] The token cache is being invalidate because project 513b3e97560445c8b2760e24c4719542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:17.127411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.128177 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07fcc845-484b-4461-a7dd-3c63ece112a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.128857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:17.129905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1180/2369] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:17 2022] DELETE /identity/v3/projects/513b3e97560445c8b2760e24c4719542 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:17.130238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.135079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74e1ac-ddfb-4fb5-bfb7-a9308c87f1c5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.135378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74e1ac-ddfb-4fb5-bfb7-a9308c87f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.135699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74e1ac-ddfb-4fb5-bfb7-a9308c87f1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.159098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fc74e1ac-ddfb-4fb5-bfb7-a9308c87f1c5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:17.160769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fc74e1ac-ddfb-4fb5-bfb7-a9308c87f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.198338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904efa49-75e8-411c-bfa8-d2e71f9382d3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.219339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:17.226614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1181/2370] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:17.234435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4340195-2122-48e7-8ac7-3c342678b640 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.234727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4340195-2122-48e7-8ac7-3c342678b640 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.234998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4340195-2122-48e7-8ac7-3c342678b640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.255445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f4340195-2122-48e7-8ac7-3c342678b640 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:17.257061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f4340195-2122-48e7-8ac7-3c342678b640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.267111 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1182/2371] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:31:17.271983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4340195-2122-48e7-8ac7-3c342678b640 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:17.285416 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4340195-2122-48e7-8ac7-3c342678b640 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.287930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.289257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.289540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.289807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] PATH_INFO: `/v3/users/5f0808fdb7914e068da8d7c21d14ff9f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.290883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4452f1-d2b1-4432-99f9-fee9192b2365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.291033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0808fdb7914e068da8d7c21d14ff9f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:17.291489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4452f1-d2b1-4432-99f9-fee9192b2365 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.291777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4452f1-d2b1-4432-99f9-fee9192b2365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.292084 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4452f1-d2b1-4432-99f9-fee9192b2365 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.293299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4452f1-d2b1-4432-99f9-fee9192b2365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:31:17.293299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4452f1-d2b1-4432-99f9-fee9192b2365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:17.294826 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4452f1-d2b1-4432-99f9-fee9192b2365 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:17.302005 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:17.310488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1183/2372] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:31:17.314356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4452f1-d2b1-4432-99f9-fee9192b2365 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:17.327529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4452f1-d2b1-4432-99f9-fee9192b2365 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.332510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e5802-94f0-49c2-b6f7-b5236b60dd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.333522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e5802-94f0-49c2-b6f7-b5236b60dd0a admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.333804 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e5802-94f0-49c2-b6f7-b5236b60dd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.334077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e5802-94f0-49c2-b6f7-b5236b60dd0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.334794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e5802-94f0-49c2-b6f7-b5236b60dd0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:17.336751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e5802-94f0-49c2-b6f7-b5236b60dd0a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:17.363066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0808fdb7914e068da8d7c21d14ff9f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.363766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0808fdb7914e068da8d7c21d14ff9f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.366694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1184/2373] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:17 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:31:17.370503 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e5802-94f0-49c2-b6f7-b5236b60dd0a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:17.382737 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0808fdb7914e068da8d7c21d14ff9f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.384178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0808fdb7914e068da8d7c21d14ff9f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.391583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0808fdb7914e068da8d7c21d14ff9f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.409154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1190/2374] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:17 2022] DELETE /identity/v3/users/5f0808fdb7914e068da8d7c21d14ff9f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:17.452629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e5802-94f0-49c2-b6f7-b5236b60dd0a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.469409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:17.526032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ed920-047c-43a5-a9f9-9566c4970df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.526736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed920-047c-43a5-a9f9-9566c4970df6 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.527000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed920-047c-43a5-a9f9-9566c4970df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.527343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ed920-047c-43a5-a9f9-9566c4970df6 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.528207 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ed920-047c-43a5-a9f9-9566c4970df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:17.530181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ed920-047c-43a5-a9f9-9566c4970df6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:17.551734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1185/2375] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:17 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:31:17.555556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:17.556983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.570905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4306293-37fa-41d6-89f9-360df61e5404 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.575849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11f10a-e529-48bc-85df-e72a84041539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.576994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11f10a-e529-48bc-85df-e72a84041539 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.576994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11f10a-e529-48bc-85df-e72a84041539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.577296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11f10a-e529-48bc-85df-e72a84041539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.578023 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11f10a-e529-48bc-85df-e72a84041539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:17.579642 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11f10a-e529-48bc-85df-e72a84041539 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:17.594007 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1191/2376] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:17.595328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ed920-047c-43a5-a9f9-9566c4970df6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:17.606572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ed920-047c-43a5-a9f9-9566c4970df6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.613641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d01f1b-1cef-4df0-b67b-a9d7e70836a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.614522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d01f1b-1cef-4df0-b67b-a9d7e70836a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.614854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d01f1b-1cef-4df0-b67b-a9d7e70836a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.615228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d01f1b-1cef-4df0-b67b-a9d7e70836a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.616174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d01f1b-1cef-4df0-b67b-a9d7e70836a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:17.617909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d01f1b-1cef-4df0-b67b-a9d7e70836a9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:17.629446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1186/2377] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:17.634033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11f10a-e529-48bc-85df-e72a84041539 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:17.646746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11f10a-e529-48bc-85df-e72a84041539 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.652551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1b3b-a48f-41bd-8ef6-7873e8eff8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.653505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1b3b-a48f-41bd-8ef6-7873e8eff8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.653784 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1b3b-a48f-41bd-8ef6-7873e8eff8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.654084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a1b3b-a48f-41bd-8ef6-7873e8eff8e6 admin admin] PATH_INFO: `/v3/projects/b6ed2dc911c44ea0953b7c849e590a8a/users/d193c0fa3d934ba99e8929b2e2ab65c3/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.669729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a1b3b-a48f-41bd-8ef6-7873e8eff8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ed2dc911c44ea0953b7c849e590a8a, user_id=d193c0fa3d934ba99e8929b2e2ab65c3, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:17.672406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a1b3b-a48f-41bd-8ef6-7873e8eff8e6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:17.688455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1192/2378] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:17 2022] PUT /identity/v3/projects/b6ed2dc911c44ea0953b7c849e590a8a/users/d193c0fa3d934ba99e8929b2e2ab65c3/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:17.694150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304be8-04c2-4a5d-8a1e-3dca6ca5a97b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.694423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304be8-04c2-4a5d-8a1e-3dca6ca5a97b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.694895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304be8-04c2-4a5d-8a1e-3dca6ca5a97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.704079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1b3b-a48f-41bd-8ef6-7873e8eff8e6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:17.706038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-291a1b3b-a48f-41bd-8ef6-7873e8eff8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.718596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-64304be8-04c2-4a5d-8a1e-3dca6ca5a97b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:17.719629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-64304be8-04c2-4a5d-8a1e-3dca6ca5a97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.785174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a1b3b-a48f-41bd-8ef6-7873e8eff8e6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.789563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1187/2379] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:17.790336 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.791211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.791491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.791761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] PATH_INFO: `/v3/projects/ce08b81972444c168e5d7ade14c5d8e9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.792972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce08b81972444c168e5d7ade14c5d8e9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:17.794901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:17.800191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64304be8-04c2-4a5d-8a1e-3dca6ca5a97b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:17.801582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-64304be8-04c2-4a5d-8a1e-3dca6ca5a97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.801898 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:17.849854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce08b81972444c168e5d7ade14c5d8e9', 'request_id': 'req-6d3f85bc-3751-440b-83f3-36d254882a25'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.863192 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64304be8-04c2-4a5d-8a1e-3dca6ca5a97b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:17.883036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce08b81972444c168e5d7ade14c5d8e9', 'request_id': 'req-6d3f85bc-3751-440b-83f3-36d254882a25'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.897131 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce08b81972444c168e5d7ade14c5d8e9', 'request_id': 'req-6d3f85bc-3751-440b-83f3-36d254882a25'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.922387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] The token cache is being invalidate because project ce08b81972444c168e5d7ade14c5d8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:17.922704 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.924374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d3f85bc-3751-440b-83f3-36d254882a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:17.929853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1193/2380] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:17 2022] DELETE /identity/v3/projects/ce08b81972444c168e5d7ade14c5d8e9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:17.931796 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4bad4-c5fb-4da2-bd4c-7e092b2f5c04 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.932119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4bad4-c5fb-4da2-bd4c-7e092b2f5c04 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.932399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4bad4-c5fb-4da2-bd4c-7e092b2f5c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.948266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b369-2907-4ce4-a994-8b1cfa8459a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:17.949652 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b369-2907-4ce4-a994-8b1cfa8459a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:17.950086 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b369-2907-4ce4-a994-8b1cfa8459a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:17.950765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b369-2907-4ce4-a994-8b1cfa8459a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:17.953518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9284b369-2907-4ce4-a994-8b1cfa8459a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.954736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-85e4bad4-c5fb-4da2-bd4c-7e092b2f5c04 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:17.955875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-85e4bad4-c5fb-4da2-bd4c-7e092b2f5c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:17.961405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:18.046053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1194/2381] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:31:18.051431 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284b369-2907-4ce4-a994-8b1cfa8459a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.053608 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284b369-2907-4ce4-a994-8b1cfa8459a8 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.054929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95e3e-6b6a-4fd1-b9df-0aa70bfe2f75 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.055230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95e3e-6b6a-4fd1-b9df-0aa70bfe2f75 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.055513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95e3e-6b6a-4fd1-b9df-0aa70bfe2f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.075278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1188/2382] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:31:18.078875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-60b95e3e-6b6a-4fd1-b9df-0aa70bfe2f75 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:18.080993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-60b95e3e-6b6a-4fd1-b9df-0aa70bfe2f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:18.090268 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1195/2383] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:18.094316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b369-2907-4ce4-a994-8b1cfa8459a8 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.105182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b369-2907-4ce4-a994-8b1cfa8459a8 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.110175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622e670-9dde-44ec-a728-a2d4d22289ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.110848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e670-9dde-44ec-a728-a2d4d22289ad admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.111275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e670-9dde-44ec-a728-a2d4d22289ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.111555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e670-9dde-44ec-a728-a2d4d22289ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.112406 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622e670-9dde-44ec-a728-a2d4d22289ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:31:18.112711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622e670-9dde-44ec-a728-a2d4d22289ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.114503 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622e670-9dde-44ec-a728-a2d4d22289ad admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.132236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1189/2384] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:31:18.133456 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b95e3e-6b6a-4fd1-b9df-0aa70bfe2f75 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.146037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b95e3e-6b6a-4fd1-b9df-0aa70bfe2f75 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.155947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53cdf9-670f-4a44-be3c-320141f70761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.156656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cdf9-670f-4a44-be3c-320141f70761 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.156940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cdf9-670f-4a44-be3c-320141f70761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.157210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53cdf9-670f-4a44-be3c-320141f70761 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.157990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53cdf9-670f-4a44-be3c-320141f70761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.159980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53cdf9-670f-4a44-be3c-320141f70761 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.201249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1196/2385] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:18 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:18.206361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622e670-9dde-44ec-a728-a2d4d22289ad admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.216517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622e670-9dde-44ec-a728-a2d4d22289ad admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.287384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f90f-9ac9-4ec4-add1-3a25b3ed30d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.288116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f90f-9ac9-4ec4-add1-3a25b3ed30d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.288738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f90f-9ac9-4ec4-add1-3a25b3ed30d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.289020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f90f-9ac9-4ec4-add1-3a25b3ed30d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.289725 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7f90f-9ac9-4ec4-add1-3a25b3ed30d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.291965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7f90f-9ac9-4ec4-add1-3a25b3ed30d1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.324735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1190/2386] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:18 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:18.326209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53cdf9-670f-4a44-be3c-320141f70761 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.336816 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53cdf9-670f-4a44-be3c-320141f70761 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.341937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37c09d-6c42-42f7-8f54-4d44f8c0c168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.342622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c09d-6c42-42f7-8f54-4d44f8c0c168 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.342995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c09d-6c42-42f7-8f54-4d44f8c0c168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.343161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c09d-6c42-42f7-8f54-4d44f8c0c168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.343901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37c09d-6c42-42f7-8f54-4d44f8c0c168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.345840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37c09d-6c42-42f7-8f54-4d44f8c0c168 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.360746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1197/2387] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:18.362342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f90f-9ac9-4ec4-add1-3a25b3ed30d1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.372827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f90f-9ac9-4ec4-add1-3a25b3ed30d1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.377618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf7f13-9b03-47c4-bd17-29aee6c1d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.378358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7f13-9b03-47c4-bd17-29aee6c1d93f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.378710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7f13-9b03-47c4-bd17-29aee6c1d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.379055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7f13-9b03-47c4-bd17-29aee6c1d93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.379876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf7f13-9b03-47c4-bd17-29aee6c1d93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.381610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf7f13-9b03-47c4-bd17-29aee6c1d93f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.392067 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1191/2388] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:31:18.396995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37c09d-6c42-42f7-8f54-4d44f8c0c168 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.418942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37c09d-6c42-42f7-8f54-4d44f8c0c168 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.424861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7fece-b749-411d-8a21-f82a0d1a33e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.425774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7fece-b749-411d-8a21-f82a0d1a33e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.426063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7fece-b749-411d-8a21-f82a0d1a33e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.426371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7fece-b749-411d-8a21-f82a0d1a33e8 admin admin] PATH_INFO: `/v3/projects/98b8fc6876b14cc69d48479c44bbda75/users/3f7d0143c7b143b3a834c90b1dd92cac/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.442851 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7fece-b749-411d-8a21-f82a0d1a33e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b8fc6876b14cc69d48479c44bbda75, user_id=3f7d0143c7b143b3a834c90b1dd92cac, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.445738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7fece-b749-411d-8a21-f82a0d1a33e8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.462106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1198/2389] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:18 2022] PUT /identity/v3/projects/98b8fc6876b14cc69d48479c44bbda75/users/3f7d0143c7b143b3a834c90b1dd92cac/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:18.473546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9acd0-6508-4347-ac1e-fbce07d06f69 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.473960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9acd0-6508-4347-ac1e-fbce07d06f69 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.475105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9acd0-6508-4347-ac1e-fbce07d06f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.506594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-20e9acd0-6508-4347-ac1e-fbce07d06f69 None None] MFA Rules not processed for user `3f7d0143c7b143b3a834c90b1dd92cac`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:18.507837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-20e9acd0-6508-4347-ac1e-fbce07d06f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:18.570922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:18.577855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1192/2390] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:18.582541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7fece-b749-411d-8a21-f82a0d1a33e8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.618064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:18.649446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7fece-b749-411d-8a21-f82a0d1a33e8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.654439 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f75000-fbeb-4856-800b-0eb808608826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.655106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75000-fbeb-4856-800b-0eb808608826 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.655406 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75000-fbeb-4856-800b-0eb808608826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.655661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75000-fbeb-4856-800b-0eb808608826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.656409 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f75000-fbeb-4856-800b-0eb808608826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.658396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f75000-fbeb-4856-800b-0eb808608826 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.688232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1199/2391] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:18 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:18.692897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9acd0-6508-4347-ac1e-fbce07d06f69 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.703837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9acd0-6508-4347-ac1e-fbce07d06f69 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.757070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b545-bca3-45b0-8af7-3d8dc23e4e7a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.757366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b545-bca3-45b0-8af7-3d8dc23e4e7a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.757625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b545-bca3-45b0-8af7-3d8dc23e4e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.775048 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dd05e-b15c-444f-8fb0-ff3dc8863c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.776361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dd05e-b15c-444f-8fb0-ff3dc8863c76 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.776655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dd05e-b15c-444f-8fb0-ff3dc8863c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.776931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dd05e-b15c-444f-8fb0-ff3dc8863c76 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.777663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dd05e-b15c-444f-8fb0-ff3dc8863c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.780259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dd05e-b15c-444f-8fb0-ff3dc8863c76 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.786783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2f44b545-bca3-45b0-8af7-3d8dc23e4e7a None None] MFA Rules not processed for user `d193c0fa3d934ba99e8929b2e2ab65c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:18.788235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2f44b545-bca3-45b0-8af7-3d8dc23e4e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:18.808993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1193/2392] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:18 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:18.811233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dd05e-b15c-444f-8fb0-ff3dc8863c76 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.824260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dd05e-b15c-444f-8fb0-ff3dc8863c76 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.828900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240cc8-a1f3-4948-b0e4-e93d0e87bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.829588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240cc8-a1f3-4948-b0e4-e93d0e87bdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.829998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240cc8-a1f3-4948-b0e4-e93d0e87bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.830269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240cc8-a1f3-4948-b0e4-e93d0e87bdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.830988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75240cc8-a1f3-4948-b0e4-e93d0e87bdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.832658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75240cc8-a1f3-4948-b0e4-e93d0e87bdc9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.843520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1194/2393] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:18.849060 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240cc8-a1f3-4948-b0e4-e93d0e87bdc9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.859305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240cc8-a1f3-4948-b0e4-e93d0e87bdc9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.867710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba104d4-38e8-46ec-ac02-cefffe280377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.868653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba104d4-38e8-46ec-ac02-cefffe280377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.868954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba104d4-38e8-46ec-ac02-cefffe280377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.869236 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba104d4-38e8-46ec-ac02-cefffe280377 admin admin] PATH_INFO: `/v3/projects/298c60a5242246a6a534f4b346c05c01/users/5b0c5602c9a949188ed520285f0603b6/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.876118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1200/2394] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:18.884595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44b545-bca3-45b0-8af7-3d8dc23e4e7a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.886285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2f44b545-bca3-45b0-8af7-3d8dc23e4e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:18.894540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba104d4-38e8-46ec-ac02-cefffe280377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298c60a5242246a6a534f4b346c05c01, user_id=5b0c5602c9a949188ed520285f0603b6, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.897876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba104d4-38e8-46ec-ac02-cefffe280377 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:18.918105 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1195/2395] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:18 2022] PUT /identity/v3/projects/298c60a5242246a6a534f4b346c05c01/users/5b0c5602c9a949188ed520285f0603b6/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:18.920507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba104d4-38e8-46ec-ac02-cefffe280377 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:18.949832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44b545-bca3-45b0-8af7-3d8dc23e4e7a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.992229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba104d4-38e8-46ec-ac02-cefffe280377 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:18.997374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34b70e-b2d0-4e4a-a70e-494d27b81a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:18.998058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b70e-b2d0-4e4a-a70e-494d27b81a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:18.998334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b70e-b2d0-4e4a-a70e-494d27b81a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:18.998606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b70e-b2d0-4e4a-a70e-494d27b81a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:18.999336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34b70e-b2d0-4e4a-a70e-494d27b81a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:18.999837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b3f18-eda6-4c2a-9cd4-2a1967df16b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:19.000534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b3f18-eda6-4c2a-9cd4-2a1967df16b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:19.000817 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b3f18-eda6-4c2a-9cd4-2a1967df16b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:19.001094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b3f18-eda6-4c2a-9cd4-2a1967df16b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:19.001188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34b70e-b2d0-4e4a-a70e-494d27b81a40 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:19.014923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1196/2396] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:19.015096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:19.016210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34b70e-b2d0-4e4a-a70e-494d27b81a40 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:19.026590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34b70e-b2d0-4e4a-a70e-494d27b81a40 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:19.031409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec172f3-050a-4d44-b36b-9697ed7e296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:19.032356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec172f3-050a-4d44-b36b-9697ed7e296b admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:19.032639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec172f3-050a-4d44-b36b-9697ed7e296b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:19.032974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec172f3-050a-4d44-b36b-9697ed7e296b admin admin] PATH_INFO: `/v3/projects/298c60a5242246a6a534f4b346c05c01/users/5b0c5602c9a949188ed520285f0603b6/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:19.035523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec172f3-050a-4d44-b36b-9697ed7e296b admin admin] RBAC: Authorizing `identity:create_grant(project_id=298c60a5242246a6a534f4b346c05c01, user_id=5b0c5602c9a949188ed520285f0603b6, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:19.038260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec172f3-050a-4d44-b36b-9697ed7e296b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:19.052290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1197/2397] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:19 2022] PUT /identity/v3/projects/298c60a5242246a6a534f4b346c05c01/users/5b0c5602c9a949188ed520285f0603b6/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:19.061146 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b3f18-eda6-4c2a-9cd4-2a1967df16b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:19.064465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b3f18-eda6-4c2a-9cd4-2a1967df16b3 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:19.064622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9157eb-d223-45c9-99cb-6aa4ed1915d7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:19.064622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9157eb-d223-45c9-99cb-6aa4ed1915d7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:19.064622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9157eb-d223-45c9-99cb-6aa4ed1915d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:19.073877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1201/2398] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:31:19.099820 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5f9157eb-d223-45c9-99cb-6aa4ed1915d7 None None] MFA Rules not processed for user `5b0c5602c9a949188ed520285f0603b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:19.101068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5f9157eb-d223-45c9-99cb-6aa4ed1915d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:19.129281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:19.228974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1198/2399] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:31:19.269544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b3f18-eda6-4c2a-9cd4-2a1967df16b3 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:19.270975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f40b3f18-eda6-4c2a-9cd4-2a1967df16b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:19.282264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b3f18-eda6-4c2a-9cd4-2a1967df16b3 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:19.334682 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146e406-f571-4456-99eb-64404e7a4548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:19.335271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146e406-f571-4456-99eb-64404e7a4548 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:19.335555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146e406-f571-4456-99eb-64404e7a4548 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:19.335830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146e406-f571-4456-99eb-64404e7a4548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:19.399779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146e406-f571-4456-99eb-64404e7a4548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:19.401276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146e406-f571-4456-99eb-64404e7a4548 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:19.411575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1202/2400] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:20.560704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1504-f0c6-46e5-a35a-8d9ea4401c78 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:20.561300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1504-f0c6-46e5-a35a-8d9ea4401c78 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:20.561300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e1504-f0c6-46e5-a35a-8d9ea4401c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:20.580272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-851e1504-f0c6-46e5-a35a-8d9ea4401c78 None None] MFA Rules not processed for user `d193c0fa3d934ba99e8929b2e2ab65c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:20.581521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-851e1504-f0c6-46e5-a35a-8d9ea4401c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:20.646033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1199/2401] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:25.582881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024fd3-3156-4280-bd55-90a67909364a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:25.583459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024fd3-3156-4280-bd55-90a67909364a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:25.583459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024fd3-3156-4280-bd55-90a67909364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:25.608711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-79024fd3-3156-4280-bd55-90a67909364a None None] MFA Rules not processed for user `30f3cc8f3f964b96b864fc8a7f86481a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:25.609943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-79024fd3-3156-4280-bd55-90a67909364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:25.677093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1203/2402] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:25.900667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e1504-f0c6-46e5-a35a-8d9ea4401c78 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:25.911618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e1504-f0c6-46e5-a35a-8d9ea4401c78 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:25.916488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bed37-ce01-4989-b4de-305afefe447c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:25.917534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bed37-ce01-4989-b4de-305afefe447c service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:25.918041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bed37-ce01-4989-b4de-305afefe447c service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:25.918511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bed37-ce01-4989-b4de-305afefe447c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:25.932422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bed37-ce01-4989-b4de-305afefe447c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:25.934136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bed37-ce01-4989-b4de-305afefe447c service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:25.953791 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1200/2403] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:29.236290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe453-6268-47b8-967f-606d9ffb3786 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:29.236871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe453-6268-47b8-967f-606d9ffb3786 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:29.237193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe453-6268-47b8-967f-606d9ffb3786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:29.260666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:29.266352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b39fe453-6268-47b8-967f-606d9ffb3786 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:29.267922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b39fe453-6268-47b8-967f-606d9ffb3786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:29.327293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1204/2404] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:31:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:29.367704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bed37-ce01-4989-b4de-305afefe447c service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:29.369347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dd0bed37-ce01-4989-b4de-305afefe447c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:29.447216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bed37-ce01-4989-b4de-305afefe447c service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:29.453468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e122d29-cf1c-4602-833a-38108281a321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:29.454112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e122d29-cf1c-4602-833a-38108281a321 service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:29.454393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e122d29-cf1c-4602-833a-38108281a321 service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:29.454663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e122d29-cf1c-4602-833a-38108281a321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:29.463129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e122d29-cf1c-4602-833a-38108281a321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:29.464746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e122d29-cf1c-4602-833a-38108281a321 service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:29.473896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1201/2405] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:31:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:31:30.054049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd297d-14fe-4da7-b064-6dc0a88b94c5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:30.054438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd297d-14fe-4da7-b064-6dc0a88b94c5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:30.054901 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd297d-14fe-4da7-b064-6dc0a88b94c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:30.078573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4dcd297d-14fe-4da7-b064-6dc0a88b94c5 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:30.079800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4dcd297d-14fe-4da7-b064-6dc0a88b94c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:30.095657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1205/2406] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 4 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:30.109788 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e122d29-cf1c-4602-833a-38108281a321 service swift] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:30.122073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e122d29-cf1c-4602-833a-38108281a321 service swift] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:30.127715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb346833-510a-4200-8522-9888b297cf63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:30.128466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb346833-510a-4200-8522-9888b297cf63 service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:30.128747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb346833-510a-4200-8522-9888b297cf63 service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:30.129214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb346833-510a-4200-8522-9888b297cf63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:30.138502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb346833-510a-4200-8522-9888b297cf63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:30.140265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb346833-510a-4200-8522-9888b297cf63 service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:30.150264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1202/2407] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:31:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:31:30.388881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75749f4-42dc-42a2-86fd-d7f5697e6494 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:30.389332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75749f4-42dc-42a2-86fd-d7f5697e6494 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:30.389437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75749f4-42dc-42a2-86fd-d7f5697e6494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:30.408175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b75749f4-42dc-42a2-86fd-d7f5697e6494 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:30.409619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b75749f4-42dc-42a2-86fd-d7f5697e6494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:30.417744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1206/2408] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:30.433950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb346833-510a-4200-8522-9888b297cf63 service swift] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:30.447302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb346833-510a-4200-8522-9888b297cf63 service swift] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:30.454407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72010c-2ff6-41e6-9a16-2780c74fa99b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:30.455079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72010c-2ff6-41e6-9a16-2780c74fa99b service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:30.455397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72010c-2ff6-41e6-9a16-2780c74fa99b service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:30.456292 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72010c-2ff6-41e6-9a16-2780c74fa99b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:30.465040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72010c-2ff6-41e6-9a16-2780c74fa99b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:30.466684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72010c-2ff6-41e6-9a16-2780c74fa99b service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:30.475361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1203/2409] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:31:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:31:30.828172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba165095-6e18-4df4-8650-1a0b57d58784 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:30.828567 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba165095-6e18-4df4-8650-1a0b57d58784 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:30.828914 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba165095-6e18-4df4-8650-1a0b57d58784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:30.847514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ba165095-6e18-4df4-8650-1a0b57d58784 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:30.848781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ba165095-6e18-4df4-8650-1a0b57d58784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:30.859122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1207/2410] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 4 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:30.871655 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72010c-2ff6-41e6-9a16-2780c74fa99b service swift] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:30.882485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72010c-2ff6-41e6-9a16-2780c74fa99b service swift] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:30.888337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8bfa7-6042-4ce1-929b-e8fa4d9b783e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:30.889050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8bfa7-6042-4ce1-929b-e8fa4d9b783e service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:30.889400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8bfa7-6042-4ce1-929b-e8fa4d9b783e service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:30.889745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8bfa7-6042-4ce1-929b-e8fa4d9b783e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:30.898542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8bfa7-6042-4ce1-929b-e8fa4d9b783e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:30.900195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8bfa7-6042-4ce1-929b-e8fa4d9b783e service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:30.908765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1204/2411] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:31:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:31:31.028401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba165095-6e18-4df4-8650-1a0b57d58784 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:31.030437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ba165095-6e18-4df4-8650-1a0b57d58784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:31.127810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba165095-6e18-4df4-8650-1a0b57d58784 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:31.155249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:31.156601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:31.157607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:31.157607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] PATH_INFO: `/v3/users/36ed91ed9b1c4c3993681863d458cc9a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:31.159746 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ed91ed9b1c4c3993681863d458cc9a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:31.162079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:31.284343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ed91ed9b1c4c3993681863d458cc9a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:31.285354 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ed91ed9b1c4c3993681863d458cc9a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:31.316325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ed91ed9b1c4c3993681863d458cc9a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:31.319446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ed91ed9b1c4c3993681863d458cc9a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:31.337766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ed91ed9b1c4c3993681863d458cc9a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:31.361545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1208/2412] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:31 2022] DELETE /identity/v3/users/36ed91ed9b1c4c3993681863d458cc9a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:31.366156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38db0-4b00-495c-8c1a-3643ff94b2e2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:31.366594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38db0-4b00-495c-8c1a-3643ff94b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:31.366884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d38db0-4b00-495c-8c1a-3643ff94b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:31.381586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:31.404973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e5d38db0-4b00-495c-8c1a-3643ff94b2e2 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:31.406641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e5d38db0-4b00-495c-8c1a-3643ff94b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:31.482148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1205/2413] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:31.492668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:31.494230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:31.500939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:31.599671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b063d-393d-428a-b28a-84a13f04e05c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:31.603998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ee0a4-d13f-410c-895b-105ec759df36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:31.604900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ee0a4-d13f-410c-895b-105ec759df36 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:31.605263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ee0a4-d13f-410c-895b-105ec759df36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:31.605605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ee0a4-d13f-410c-895b-105ec759df36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:31.616413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ee0a4-d13f-410c-895b-105ec759df36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:31.618092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ee0a4-d13f-410c-895b-105ec759df36 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:31.631620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1209/2414] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:32.052455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d38db0-4b00-495c-8c1a-3643ff94b2e2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:32.054324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e5d38db0-4b00-495c-8c1a-3643ff94b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:32.077469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d38db0-4b00-495c-8c1a-3643ff94b2e2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:32.083439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:32.084671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.085284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.085797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] PATH_INFO: `/v3/projects/262379cecac54fadb3ad9b63f2033bf0` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.087517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=262379cecac54fadb3ad9b63f2033bf0)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:32.089969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:32.189711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262379cecac54fadb3ad9b63f2033bf0', 'request_id': 'req-84bb48be-9e60-42bd-aa8b-2933f934bb8b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:32.201846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262379cecac54fadb3ad9b63f2033bf0', 'request_id': 'req-84bb48be-9e60-42bd-aa8b-2933f934bb8b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:32.210975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262379cecac54fadb3ad9b63f2033bf0', 'request_id': 'req-84bb48be-9e60-42bd-aa8b-2933f934bb8b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:32.230225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ee0a4-d13f-410c-895b-105ec759df36 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:32.231721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-542ee0a4-d13f-410c-895b-105ec759df36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:32.236263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] The token cache is being invalidate because project 262379cecac54fadb3ad9b63f2033bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:32.237005 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:32.238320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-84bb48be-9e60-42bd-aa8b-2933f934bb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:32.246053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1206/2415] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:32 2022] DELETE /identity/v3/projects/262379cecac54fadb3ad9b63f2033bf0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:32.247943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ee0a4-d13f-410c-895b-105ec759df36 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:32.248910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa45b-96f0-49b0-8727-2ba322029ad4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.249201 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa45b-96f0-49b0-8727-2ba322029ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.250715 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa45b-96f0-49b0-8727-2ba322029ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.319729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d84fa45b-96f0-49b0-8727-2ba322029ad4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:32.324307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d84fa45b-96f0-49b0-8727-2ba322029ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:32.360574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:32.361188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.361452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.363144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] PATH_INFO: `/v3/users/3f7d0143c7b143b3a834c90b1dd92cac` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.376685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7d0143c7b143b3a834c90b1dd92cac)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:32.380055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:32.461417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7d0143c7b143b3a834c90b1dd92cac'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:32.462497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7d0143c7b143b3a834c90b1dd92cac'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:32.480236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7d0143c7b143b3a834c90b1dd92cac'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:32.480949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7d0143c7b143b3a834c90b1dd92cac'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:32.486664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1207/2416] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:32.494611 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cb1afe47-f0f3-4614-b8d0-49e5e3c3c9d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7d0143c7b143b3a834c90b1dd92cac'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:32.495225 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a3481-53d2-43ca-a807-dbf9a24ea6aa None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.495542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a3481-53d2-43ca-a807-dbf9a24ea6aa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.495896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a3481-53d2-43ca-a807-dbf9a24ea6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.519590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-577a3481-53d2-43ca-a807-dbf9a24ea6aa None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:32.520935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-577a3481-53d2-43ca-a807-dbf9a24ea6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:32.523106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1210/2417] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:32 2022] DELETE /identity/v3/users/3f7d0143c7b143b3a834c90b1dd92cac => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:32.530226 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e315-da57-4813-a046-739ae4565d38 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.530857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e315-da57-4813-a046-739ae4565d38 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.532361 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e315-da57-4813-a046-739ae4565d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.546872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:32.572357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8251e315-da57-4813-a046-739ae4565d38 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:32.574547 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8251e315-da57-4813-a046-739ae4565d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:32.603522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:32.629672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1208/2418] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:31:32.633981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a3481-53d2-43ca-a807-dbf9a24ea6aa None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:32.644298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a3481-53d2-43ca-a807-dbf9a24ea6aa None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:32.649615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0fd8a-44b9-40a4-be01-47d80078dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:32.650497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0fd8a-44b9-40a4-be01-47d80078dfdd admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.650938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0fd8a-44b9-40a4-be01-47d80078dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.651357 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0fd8a-44b9-40a4-be01-47d80078dfdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.652314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0fd8a-44b9-40a4-be01-47d80078dfdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:31:32.652789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0fd8a-44b9-40a4-be01-47d80078dfdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:32.654625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1211/2419] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:32.654823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0fd8a-44b9-40a4-be01-47d80078dfdd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:32.664777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251e315-da57-4813-a046-739ae4565d38 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:32.666209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8251e315-da57-4813-a046-739ae4565d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:32.677210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1209/2420] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:31:32.678117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0fd8a-44b9-40a4-be01-47d80078dfdd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:32.689540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0fd8a-44b9-40a4-be01-47d80078dfdd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:32.694764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175dfde-0eba-4058-9617-c7d88150f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:32.695582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175dfde-0eba-4058-9617-c7d88150f902 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.695874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175dfde-0eba-4058-9617-c7d88150f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.696179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175dfde-0eba-4058-9617-c7d88150f902 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.696879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175dfde-0eba-4058-9617-c7d88150f902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:32.698805 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175dfde-0eba-4058-9617-c7d88150f902 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:32.727411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1210/2421] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:32 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:32.731588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175dfde-0eba-4058-9617-c7d88150f902 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:32.733356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251e315-da57-4813-a046-739ae4565d38 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:32.782541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d756c36-34f4-47d9-8786-c72d6ced4fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:32.783195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d756c36-34f4-47d9-8786-c72d6ced4fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.783750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d756c36-34f4-47d9-8786-c72d6ced4fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.784251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d756c36-34f4-47d9-8786-c72d6ced4fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.792784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175dfde-0eba-4058-9617-c7d88150f902 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:32.793953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d756c36-34f4-47d9-8786-c72d6ced4fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:32.795395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d756c36-34f4-47d9-8786-c72d6ced4fd9 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:32.797522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48aea9-f18c-4dee-822f-8e82ee6656c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:32.798203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48aea9-f18c-4dee-822f-8e82ee6656c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.798489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48aea9-f18c-4dee-822f-8e82ee6656c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.798765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48aea9-f18c-4dee-822f-8e82ee6656c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.799636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48aea9-f18c-4dee-822f-8e82ee6656c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:32.801635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48aea9-f18c-4dee-822f-8e82ee6656c1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:32.805229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1212/2422] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:31:32.823452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1211/2423] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:32 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:31:32.827706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d756c36-34f4-47d9-8786-c72d6ced4fd9 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:32.837674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d756c36-34f4-47d9-8786-c72d6ced4fd9 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:32.842970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557bad1-7c15-4cc1-a6d1-95bcdc9e54a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:32.843662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557bad1-7c15-4cc1-a6d1-95bcdc9e54a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.843947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557bad1-7c15-4cc1-a6d1-95bcdc9e54a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.844444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557bad1-7c15-4cc1-a6d1-95bcdc9e54a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.845177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557bad1-7c15-4cc1-a6d1-95bcdc9e54a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:32.846847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557bad1-7c15-4cc1-a6d1-95bcdc9e54a8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:32.861012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1213/2424] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:32.862461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48aea9-f18c-4dee-822f-8e82ee6656c1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:32.873588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48aea9-f18c-4dee-822f-8e82ee6656c1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:32.878380 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66183637-63f9-491b-a148-d1f8c8f54891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:32.879096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183637-63f9-491b-a148-d1f8c8f54891 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.879382 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183637-63f9-491b-a148-d1f8c8f54891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.879654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66183637-63f9-491b-a148-d1f8c8f54891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.880556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66183637-63f9-491b-a148-d1f8c8f54891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:32.882244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66183637-63f9-491b-a148-d1f8c8f54891 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:32.894272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1212/2425] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:31:32.897200 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557bad1-7c15-4cc1-a6d1-95bcdc9e54a8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:32.908179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557bad1-7c15-4cc1-a6d1-95bcdc9e54a8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:32.913671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a10e6-3845-47ef-8334-5c0bf1e00a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:32.914637 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a10e6-3845-47ef-8334-5c0bf1e00a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.915056 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a10e6-3845-47ef-8334-5c0bf1e00a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.915263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a10e6-3845-47ef-8334-5c0bf1e00a54 admin admin] PATH_INFO: `/v3/projects/c0464df6f45240a38b66c5a266e7073c/users/4ae9fed67bb14380aeacb2900242c516/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.930551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a10e6-3845-47ef-8334-5c0bf1e00a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0464df6f45240a38b66c5a266e7073c, user_id=4ae9fed67bb14380aeacb2900242c516, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:32.933236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a10e6-3845-47ef-8334-5c0bf1e00a54 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:32.958156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1214/2426] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:32 2022] PUT /identity/v3/projects/c0464df6f45240a38b66c5a266e7073c/users/4ae9fed67bb14380aeacb2900242c516/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:32.961643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b0963-05f9-4501-8471-7de6eb9926d4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:32.961813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b0963-05f9-4501-8471-7de6eb9926d4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:32.962186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b0963-05f9-4501-8471-7de6eb9926d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:32.990592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bb1b0963-05f9-4501-8471-7de6eb9926d4 None None] MFA Rules not processed for user `4ae9fed67bb14380aeacb2900242c516`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:32.991830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bb1b0963-05f9-4501-8471-7de6eb9926d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:33.039898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:33.057789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1213/2427] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:33.068630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a10e6-3845-47ef-8334-5c0bf1e00a54 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:33.070280 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ad6a10e6-3845-47ef-8334-5c0bf1e00a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:33.089088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b0963-05f9-4501-8471-7de6eb9926d4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:33.090506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bb1b0963-05f9-4501-8471-7de6eb9926d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:33.139519 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a10e6-3845-47ef-8334-5c0bf1e00a54 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:33.144862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75283395-5a80-4910-a216-6afb224a2499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:33.145709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283395-5a80-4910-a216-6afb224a2499 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:33.145988 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283395-5a80-4910-a216-6afb224a2499 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:33.146258 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75283395-5a80-4910-a216-6afb224a2499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:33.151883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:33.156036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75283395-5a80-4910-a216-6afb224a2499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:33.157961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75283395-5a80-4910-a216-6afb224a2499 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:33.168568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1215/2428] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:33.170340 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b0963-05f9-4501-8471-7de6eb9926d4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:33.176295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:33.177648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:33.178271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:33.178712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] PATH_INFO: `/v3/projects/98b8fc6876b14cc69d48479c44bbda75` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:33.180176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b8fc6876b14cc69d48479c44bbda75)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:33.182914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:33.245448 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b8fc6876b14cc69d48479c44bbda75', 'request_id': 'req-579ce960-5aa6-4691-a140-bac59760611c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.253463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b8fc6876b14cc69d48479c44bbda75', 'request_id': 'req-579ce960-5aa6-4691-a140-bac59760611c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.260707 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b8fc6876b14cc69d48479c44bbda75', 'request_id': 'req-579ce960-5aa6-4691-a140-bac59760611c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.277819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] The token cache is being invalidate because project 98b8fc6876b14cc69d48479c44bbda75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:33.278847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.279666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.281348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1214/2429] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:33 2022] DELETE /identity/v3/projects/98b8fc6876b14cc69d48479c44bbda75 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:33.285652 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75283395-5a80-4910-a216-6afb224a2499 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:33.301802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75283395-5a80-4910-a216-6afb224a2499 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:33.365500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:33.366402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:33.366824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:33.367107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] PATH_INFO: `/v3/users/5b0c5602c9a949188ed520285f0603b6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:33.368844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0c5602c9a949188ed520285f0603b6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:33.371139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:33.402045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:33.404653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:33.419365 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ce960-5aa6-4691-a140-bac59760611c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:33.424499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:33.425771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:33.426055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:33.426584 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] PATH_INFO: `/v3/users/e14262d9579e4e4293a2748aa894a94c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:33.427862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14262d9579e4e4293a2748aa894a94c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:33.430088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:33.435132 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0c5602c9a949188ed520285f0603b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.435820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0c5602c9a949188ed520285f0603b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.463802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0c5602c9a949188ed520285f0603b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.464611 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0c5602c9a949188ed520285f0603b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.476554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59134005-a2cd-4d4f-b494-74e57352d67d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0c5602c9a949188ed520285f0603b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.497583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1216/2430] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:33 2022] DELETE /identity/v3/users/5b0c5602c9a949188ed520285f0603b6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:33.505143 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14262d9579e4e4293a2748aa894a94c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.517912 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14262d9579e4e4293a2748aa894a94c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.529046 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14262d9579e4e4293a2748aa894a94c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.535090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:33.538748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14262d9579e4e4293a2748aa894a94c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.539770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14262d9579e4e4293a2748aa894a94c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.553282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1215/2431] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:33 2022] DELETE /identity/v3/users/e14262d9579e4e4293a2748aa894a94c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:33.554625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3a16-d6d9-4002-9d92-95dbcfb42c40 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:33.554931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3a16-d6d9-4002-9d92-95dbcfb42c40 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:33.555208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c3a16-d6d9-4002-9d92-95dbcfb42c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:33.576289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-266c3a16-d6d9-4002-9d92-95dbcfb42c40 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:33.577441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-266c3a16-d6d9-4002-9d92-95dbcfb42c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:33.642819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1217/2432] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:33.654064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:33.655690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:33.730337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81748880-3673-4605-abcc-881bee1fe577 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:33.734502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec9c7-8a35-441c-96f1-925f998bb249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:33.735168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec9c7-8a35-441c-96f1-925f998bb249 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:33.735452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec9c7-8a35-441c-96f1-925f998bb249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:33.735732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec9c7-8a35-441c-96f1-925f998bb249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:33.746426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec9c7-8a35-441c-96f1-925f998bb249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:33.747875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec9c7-8a35-441c-96f1-925f998bb249 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:33.759997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1216/2433] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:33.838973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c3a16-d6d9-4002-9d92-95dbcfb42c40 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:33.840754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-266c3a16-d6d9-4002-9d92-95dbcfb42c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:33.852939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c3a16-d6d9-4002-9d92-95dbcfb42c40 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:33.857629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:33.858592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:33.858932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:33.859267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] PATH_INFO: `/v3/projects/298c60a5242246a6a534f4b346c05c01` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:33.860541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=298c60a5242246a6a534f4b346c05c01)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:33.863420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:33.873053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:33.931520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298c60a5242246a6a534f4b346c05c01', 'request_id': 'req-ce17a743-df41-4523-83c4-2e1d3c228bf3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.941207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298c60a5242246a6a534f4b346c05c01', 'request_id': 'req-ce17a743-df41-4523-83c4-2e1d3c228bf3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.947811 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298c60a5242246a6a534f4b346c05c01', 'request_id': 'req-ce17a743-df41-4523-83c4-2e1d3c228bf3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.958562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] The token cache is being invalidate because project 298c60a5242246a6a534f4b346c05c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:33.958916 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.959695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ce17a743-df41-4523-83c4-2e1d3c228bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:33.961395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1218/2434] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:33 2022] DELETE /identity/v3/projects/298c60a5242246a6a534f4b346c05c01 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:34.001769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec9c7-8a35-441c-96f1-925f998bb249 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:34.003602 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ef1ec9c7-8a35-441c-96f1-925f998bb249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:34.023998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec9c7-8a35-441c-96f1-925f998bb249 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:34.088152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:34.089057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.089356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.089588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] PATH_INFO: `/v3/projects/9e37d22450ca4de287112487fa563163` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.090975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e37d22450ca4de287112487fa563163)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:34.093026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:34.151801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e37d22450ca4de287112487fa563163', 'request_id': 'req-bc57dfcb-5058-4864-9225-0c3e475dc611'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:34.157603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e37d22450ca4de287112487fa563163', 'request_id': 'req-bc57dfcb-5058-4864-9225-0c3e475dc611'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:34.165666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e37d22450ca4de287112487fa563163', 'request_id': 'req-bc57dfcb-5058-4864-9225-0c3e475dc611'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:34.185116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] The token cache is being invalidate because project 9e37d22450ca4de287112487fa563163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:34.185529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:34.186200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bc57dfcb-5058-4864-9225-0c3e475dc611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:34.187891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1217/2435] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:34 2022] DELETE /identity/v3/projects/9e37d22450ca4de287112487fa563163 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:34.194022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafb792-ce20-4487-b410-e400950db1c7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.194248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafb792-ce20-4487-b410-e400950db1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.194529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafb792-ce20-4487-b410-e400950db1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.213734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-baafb792-ce20-4487-b410-e400950db1c7 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:34.214948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-baafb792-ce20-4487-b410-e400950db1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:34.279240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1219/2436] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:34.288853 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa7931-0cb8-4ff9-9db2-1df99b723bce None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.289144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa7931-0cb8-4ff9-9db2-1df99b723bce None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.290557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa7931-0cb8-4ff9-9db2-1df99b723bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.316832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-18aa7931-0cb8-4ff9-9db2-1df99b723bce None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:34.318115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-18aa7931-0cb8-4ff9-9db2-1df99b723bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:34.327528 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1218/2437] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:34.331987 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafb792-ce20-4487-b410-e400950db1c7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:34.342806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafb792-ce20-4487-b410-e400950db1c7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:34.348216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a520d8-5b09-4fa3-a036-33539022308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:34.349003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a520d8-5b09-4fa3-a036-33539022308c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.349285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a520d8-5b09-4fa3-a036-33539022308c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.349803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a520d8-5b09-4fa3-a036-33539022308c admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.350612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a520d8-5b09-4fa3-a036-33539022308c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:31:34.350920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a520d8-5b09-4fa3-a036-33539022308c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:34.352972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a520d8-5b09-4fa3-a036-33539022308c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:34.369082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1220/2438] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:31:34.370018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa7931-0cb8-4ff9-9db2-1df99b723bce None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:34.379583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa7931-0cb8-4ff9-9db2-1df99b723bce None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:34.384964 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072270-ab33-45cd-8eb3-e3e81b433cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:34.385706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072270-ab33-45cd-8eb3-e3e81b433cef admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.386080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072270-ab33-45cd-8eb3-e3e81b433cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.386446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072270-ab33-45cd-8eb3-e3e81b433cef admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.387228 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072270-ab33-45cd-8eb3-e3e81b433cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:34.389367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072270-ab33-45cd-8eb3-e3e81b433cef admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:34.412489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:34.424253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1219/2439] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:34 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:31:34.428167 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a520d8-5b09-4fa3-a036-33539022308c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:34.438023 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a520d8-5b09-4fa3-a036-33539022308c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:34.494623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ce99-28ff-47fc-a935-11a3e8e4babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:34.495399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ce99-28ff-47fc-a935-11a3e8e4babc admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.495740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ce99-28ff-47fc-a935-11a3e8e4babc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.496039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ce99-28ff-47fc-a935-11a3e8e4babc admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.496813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516ce99-28ff-47fc-a935-11a3e8e4babc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:34.498740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516ce99-28ff-47fc-a935-11a3e8e4babc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:34.520823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1221/2440] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:34 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:34.525006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072270-ab33-45cd-8eb3-e3e81b433cef admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:34.538712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072270-ab33-45cd-8eb3-e3e81b433cef admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:34.544353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763046ec-3f27-4adc-b7ca-e8f28e79502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:34.545073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763046ec-3f27-4adc-b7ca-e8f28e79502b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.545359 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763046ec-3f27-4adc-b7ca-e8f28e79502b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.545638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763046ec-3f27-4adc-b7ca-e8f28e79502b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.546514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763046ec-3f27-4adc-b7ca-e8f28e79502b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:34.548162 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763046ec-3f27-4adc-b7ca-e8f28e79502b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:34.559401 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1220/2441] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:34.563264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ce99-28ff-47fc-a935-11a3e8e4babc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:34.573560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ce99-28ff-47fc-a935-11a3e8e4babc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:34.578177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964031bf-abe1-4778-8feb-0bdf2b6d1a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:34.578847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964031bf-abe1-4778-8feb-0bdf2b6d1a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.579134 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964031bf-abe1-4778-8feb-0bdf2b6d1a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.579412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964031bf-abe1-4778-8feb-0bdf2b6d1a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.580225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964031bf-abe1-4778-8feb-0bdf2b6d1a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:34.582017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964031bf-abe1-4778-8feb-0bdf2b6d1a9b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:34.592685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1222/2442] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:34.596741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763046ec-3f27-4adc-b7ca-e8f28e79502b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:34.606654 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763046ec-3f27-4adc-b7ca-e8f28e79502b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:34.611245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb84e-76e6-4435-b774-9c9dbc7f05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:34.612266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb84e-76e6-4435-b774-9c9dbc7f05f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.612543 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb84e-76e6-4435-b774-9c9dbc7f05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.612815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb84e-76e6-4435-b774-9c9dbc7f05f8 admin admin] PATH_INFO: `/v3/projects/5cfb3750227e4037b6e92552361366f4/users/2e0bd04828eb48bdbfe09fd01130ac73/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.629829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eb84e-76e6-4435-b774-9c9dbc7f05f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfb3750227e4037b6e92552361366f4, user_id=2e0bd04828eb48bdbfe09fd01130ac73, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:34.632562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eb84e-76e6-4435-b774-9c9dbc7f05f8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:34.648648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1221/2443] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:34 2022] PUT /identity/v3/projects/5cfb3750227e4037b6e92552361366f4/users/2e0bd04828eb48bdbfe09fd01130ac73/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:34.654100 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da13f88-a7d3-4f21-b871-36b26bd33335 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.654390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da13f88-a7d3-4f21-b871-36b26bd33335 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.654664 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da13f88-a7d3-4f21-b871-36b26bd33335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.661288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:34.675904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4da13f88-a7d3-4f21-b871-36b26bd33335 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:34.677154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4da13f88-a7d3-4f21-b871-36b26bd33335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:34.756832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1223/2444] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:34.766625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb84e-76e6-4435-b774-9c9dbc7f05f8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:34.769274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-017eb84e-76e6-4435-b774-9c9dbc7f05f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:34.836300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb84e-76e6-4435-b774-9c9dbc7f05f8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:34.840169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e6124-c5b1-4af6-8c0a-3cfef9c791be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:34.840829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6124-c5b1-4af6-8c0a-3cfef9c791be service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:34.841110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6124-c5b1-4af6-8c0a-3cfef9c791be service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:34.841384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6124-c5b1-4af6-8c0a-3cfef9c791be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:34.852356 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e6124-c5b1-4af6-8c0a-3cfef9c791be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:34.853818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e6124-c5b1-4af6-8c0a-3cfef9c791be service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:34.864195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1222/2445] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:31:39.544678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24349-d119-4f5b-9ff1-c9903d88cf35 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:39.545187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24349-d119-4f5b-9ff1-c9903d88cf35 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:39.545283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed24349-d119-4f5b-9ff1-c9903d88cf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:39.576491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2ed24349-d119-4f5b-9ff1-c9903d88cf35 None None] MFA Rules not processed for user `2e0bd04828eb48bdbfe09fd01130ac73`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:39.577825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2ed24349-d119-4f5b-9ff1-c9903d88cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:39.650688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1224/2446] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:39.655240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e6124-c5b1-4af6-8c0a-3cfef9c791be service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:39.665611 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e6124-c5b1-4af6-8c0a-3cfef9c791be service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:39.671268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b820286-fcf8-4206-8eae-1b6d58ac48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:39.671953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b820286-fcf8-4206-8eae-1b6d58ac48ee admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:39.672974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b820286-fcf8-4206-8eae-1b6d58ac48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:39.672974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b820286-fcf8-4206-8eae-1b6d58ac48ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:39.673883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b820286-fcf8-4206-8eae-1b6d58ac48ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:39.675403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b820286-fcf8-4206-8eae-1b6d58ac48ee admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:39.708678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1223/2447] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:31:39 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:39.713117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed24349-d119-4f5b-9ff1-c9903d88cf35 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:39.731118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed24349-d119-4f5b-9ff1-c9903d88cf35 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:39.808729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81374999-a4fb-44f4-9843-d5fe21e3a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:39.809437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81374999-a4fb-44f4-9843-d5fe21e3a9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:39.809718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81374999-a4fb-44f4-9843-d5fe21e3a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:39.810260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81374999-a4fb-44f4-9843-d5fe21e3a9b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:39.811141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81374999-a4fb-44f4-9843-d5fe21e3a9b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:39.813425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81374999-a4fb-44f4-9843-d5fe21e3a9b8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:39.841573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1225/2448] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:31:39 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:31:39.846726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b820286-fcf8-4206-8eae-1b6d58ac48ee admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:39.860767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b820286-fcf8-4206-8eae-1b6d58ac48ee admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:39.867139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5af74f-f218-44b6-8f6c-a72fc76dd9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:39.871413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5af74f-f218-44b6-8f6c-a72fc76dd9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:39.881339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5af74f-f218-44b6-8f6c-a72fc76dd9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:39.883556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5af74f-f218-44b6-8f6c-a72fc76dd9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:39.887182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5af74f-f218-44b6-8f6c-a72fc76dd9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:39.889040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5af74f-f218-44b6-8f6c-a72fc76dd9bd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:39.909211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1224/2449] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:39.910680 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81374999-a4fb-44f4-9843-d5fe21e3a9b8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:39.922434 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81374999-a4fb-44f4-9843-d5fe21e3a9b8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:39.927312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d2b41-4839-4478-9765-6c0718dd91db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:39.928243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d2b41-4839-4478-9765-6c0718dd91db admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:39.928641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d2b41-4839-4478-9765-6c0718dd91db admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:39.928769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d2b41-4839-4478-9765-6c0718dd91db admin admin] PATH_INFO: `/v3/projects/b2310b63331c4b9ea9d68e9ceaaf866e/users/955cdc78d512491d85220fe7dc8e764b/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:39.944831 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d2b41-4839-4478-9765-6c0718dd91db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2310b63331c4b9ea9d68e9ceaaf866e, user_id=955cdc78d512491d85220fe7dc8e764b, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:39.947690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d2b41-4839-4478-9765-6c0718dd91db admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:39.963213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:39.971324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1226/2450] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:39 2022] PUT /identity/v3/projects/b2310b63331c4b9ea9d68e9ceaaf866e/users/955cdc78d512491d85220fe7dc8e764b/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:39.976893 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5af74f-f218-44b6-8f6c-a72fc76dd9bd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:39.993511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5af74f-f218-44b6-8f6c-a72fc76dd9bd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:40.088307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d6951-7f53-4b1f-95ec-c7bd13ff3d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:40.089006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6951-7f53-4b1f-95ec-c7bd13ff3d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:40.089283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6951-7f53-4b1f-95ec-c7bd13ff3d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:40.089587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6951-7f53-4b1f-95ec-c7bd13ff3d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:40.090411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d6951-7f53-4b1f-95ec-c7bd13ff3d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:40.092040 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d6951-7f53-4b1f-95ec-c7bd13ff3d08 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:40.102698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1225/2451] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:31:40.106982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d2b41-4839-4478-9765-6c0718dd91db admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:40.118028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d2b41-4839-4478-9765-6c0718dd91db admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:40.122764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890c191-848c-466a-930a-a0619b719350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:40.123734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890c191-848c-466a-930a-a0619b719350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:40.124115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890c191-848c-466a-930a-a0619b719350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:40.124464 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890c191-848c-466a-930a-a0619b719350 admin admin] PATH_INFO: `/v3/projects/b2310b63331c4b9ea9d68e9ceaaf866e/users/955cdc78d512491d85220fe7dc8e764b/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:40.126467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890c191-848c-466a-930a-a0619b719350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2310b63331c4b9ea9d68e9ceaaf866e, user_id=955cdc78d512491d85220fe7dc8e764b, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:40.129939 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890c191-848c-466a-930a-a0619b719350 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:40.141436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1227/2452] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:31:40 2022] PUT /identity/v3/projects/b2310b63331c4b9ea9d68e9ceaaf866e/users/955cdc78d512491d85220fe7dc8e764b/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:31:45.317028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f399a-d8fd-4abf-bcb0-ca541cd5764a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:45.317420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f399a-d8fd-4abf-bcb0-ca541cd5764a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:45.317681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f399a-d8fd-4abf-bcb0-ca541cd5764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:45.370747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9b2f399a-d8fd-4abf-bcb0-ca541cd5764a None None] MFA Rules not processed for user `955cdc78d512491d85220fe7dc8e764b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:45.372795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9b2f399a-d8fd-4abf-bcb0-ca541cd5764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:45.392554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:45.447140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1226/2453] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:45.461873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890c191-848c-466a-930a-a0619b719350 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:45.463923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a890c191-848c-466a-930a-a0619b719350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:45.535990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890c191-848c-466a-930a-a0619b719350 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:45.540624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98514-61ae-4632-9556-40857dbadcb5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4adc107bf542b8bb0502c7fbf94431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:45.541397 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98514-61ae-4632-9556-40857dbadcb5 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:45.541872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98514-61ae-4632-9556-40857dbadcb5 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:45.542252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98514-61ae-4632-9556-40857dbadcb5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:45.604620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe98514-61ae-4632-9556-40857dbadcb5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:45.606164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe98514-61ae-4632-9556-40857dbadcb5 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:45.615621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1228/2454] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:45.729064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f3ba-2914-4ef2-b3fa-d7a23de84424 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:45.729418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f3ba-2914-4ef2-b3fa-d7a23de84424 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:45.729753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f3ba-2914-4ef2-b3fa-d7a23de84424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:45.754033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3c85f3ba-2914-4ef2-b3fa-d7a23de84424 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:45.755413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3c85f3ba-2914-4ef2-b3fa-d7a23de84424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:45.820669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1227/2455] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:45.841953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98514-61ae-4632-9556-40857dbadcb5 service glance] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:45.843241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cbe98514-61ae-4632-9556-40857dbadcb5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:45.927324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98514-61ae-4632-9556-40857dbadcb5 service glance] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:45.933366 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f17fc-6459-469f-8d17-93a9d56548f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:45.934037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f17fc-6459-469f-8d17-93a9d56548f7 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:45.934348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f17fc-6459-469f-8d17-93a9d56548f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:45.934592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f17fc-6459-469f-8d17-93a9d56548f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:45.943716 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f17fc-6459-469f-8d17-93a9d56548f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:45.945396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f17fc-6459-469f-8d17-93a9d56548f7 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:45.954273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1229/2456] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:31:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:31:54.327165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85f3ba-2914-4ef2-b3fa-d7a23de84424 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:54.328659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3c85f3ba-2914-4ef2-b3fa-d7a23de84424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:54.479957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85f3ba-2914-4ef2-b3fa-d7a23de84424 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:54.486521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707960-0306-40a7-9cfb-d043ac948132 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:54.487535 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707960-0306-40a7-9cfb-d043ac948132 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:54.488110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707960-0306-40a7-9cfb-d043ac948132 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:54.488625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707960-0306-40a7-9cfb-d043ac948132 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:54.491567 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7d707960-0306-40a7-9cfb-d043ac948132 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:54.506535 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707960-0306-40a7-9cfb-d043ac948132 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:54.508673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707960-0306-40a7-9cfb-d043ac948132 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:54.522822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1228/2457] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:55.826422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a3fe6-5959-4857-934f-a0e9924117ed None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:55.826982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a3fe6-5959-4857-934f-a0e9924117ed None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:55.826982 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a3fe6-5959-4857-934f-a0e9924117ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:55.845204 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-599a3fe6-5959-4857-934f-a0e9924117ed None None] MFA Rules not processed for user `2e0bd04828eb48bdbfe09fd01130ac73`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:55.846446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-599a3fe6-5959-4857-934f-a0e9924117ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:55.853360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1230/2458] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:57.958621 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6d3aa-4b96-4d38-ba35-16f5d494e031 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:57.959173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6d3aa-4b96-4d38-ba35-16f5d494e031 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:57.959300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6d3aa-4b96-4d38-ba35-16f5d494e031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:58.007450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:58.016267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3db6d3aa-4b96-4d38-ba35-16f5d494e031 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:58.017516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3db6d3aa-4b96-4d38-ba35-16f5d494e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:58.035504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1229/2459] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:31:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:58.048248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a3fe6-5959-4857-934f-a0e9924117ed None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:58.070537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a3fe6-5959-4857-934f-a0e9924117ed None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:58.075658 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe1375-b2cb-46a6-9436-ab535a1e8c90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:58.076373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1375-b2cb-46a6-9436-ab535a1e8c90 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:58.076650 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1375-b2cb-46a6-9436-ab535a1e8c90 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:58.076923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1375-b2cb-46a6-9436-ab535a1e8c90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:58.085346 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe1375-b2cb-46a6-9436-ab535a1e8c90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:58.086935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe1375-b2cb-46a6-9436-ab535a1e8c90 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:58.091654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:31:58.095678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1231/2460] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:31:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:31:58.443405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6d3aa-4b96-4d38-ba35-16f5d494e031 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:58.444504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3db6d3aa-4b96-4d38-ba35-16f5d494e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:58.573095 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6d3aa-4b96-4d38-ba35-16f5d494e031 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:58.601282 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:58.602326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:58.602628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:58.602935 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] PATH_INFO: `/v3/users/4ae9fed67bb14380aeacb2900242c516` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:58.607766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae9fed67bb14380aeacb2900242c516)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:58.609797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:58.693751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae9fed67bb14380aeacb2900242c516'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:58.726857 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae9fed67bb14380aeacb2900242c516'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:58.742818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae9fed67bb14380aeacb2900242c516'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:58.753855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae9fed67bb14380aeacb2900242c516'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:58.754582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae9fed67bb14380aeacb2900242c516'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:58.762738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1230/2461] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:31:58 2022] DELETE /identity/v3/users/4ae9fed67bb14380aeacb2900242c516 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:31:58.767621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dbdb6-c647-4759-93e5-63df5dd27a8f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:58.769177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dbdb6-c647-4759-93e5-63df5dd27a8f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:58.769596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dbdb6-c647-4759-93e5-63df5dd27a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:58.815649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5a6dbdb6-c647-4759-93e5-63df5dd27a8f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:31:58.817177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5a6dbdb6-c647-4759-93e5-63df5dd27a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:58.919919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1232/2462] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:31:58.925795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:58.927270 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:58.996781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1280ef-c9c3-4aab-9ec7-2643aeb54840 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:59.005658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0066ac-33f4-4c62-a872-56a08dac6d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:59.006360 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0066ac-33f4-4c62-a872-56a08dac6d9e service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:59.006650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0066ac-33f4-4c62-a872-56a08dac6d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:59.007524 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0066ac-33f4-4c62-a872-56a08dac6d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:59.024794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0066ac-33f4-4c62-a872-56a08dac6d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:59.029435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0066ac-33f4-4c62-a872-56a08dac6d9e service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:59.047644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1231/2463] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:31:59.401255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dbdb6-c647-4759-93e5-63df5dd27a8f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:31:59.405253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5a6dbdb6-c647-4759-93e5-63df5dd27a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:31:59.451805 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dbdb6-c647-4759-93e5-63df5dd27a8f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:31:59.458198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:31:59.459206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:31:59.459583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:31:59.459949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] PATH_INFO: `/v3/projects/c0464df6f45240a38b66c5a266e7073c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:31:59.461825 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0464df6f45240a38b66c5a266e7073c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:31:59.464509 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:31:59.601929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0464df6f45240a38b66c5a266e7073c', 'request_id': 'req-c6195e99-f292-443c-a2a5-05628d27a545'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:59.620190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0464df6f45240a38b66c5a266e7073c', 'request_id': 'req-c6195e99-f292-443c-a2a5-05628d27a545'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:59.629959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0464df6f45240a38b66c5a266e7073c', 'request_id': 'req-c6195e99-f292-443c-a2a5-05628d27a545'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:59.647581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] The token cache is being invalidate because project c0464df6f45240a38b66c5a266e7073c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:31:59.647878 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:59.648648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6195e99-f292-443c-a2a5-05628d27a545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:31:59.650627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1233/2464] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:31:59 2022] DELETE /identity/v3/projects/c0464df6f45240a38b66c5a266e7073c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:32:09.043271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:09.644141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:32:40.762727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0066ac-33f4-4c62-a872-56a08dac6d9e service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:32:40.765029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7c0066ac-33f4-4c62-a872-56a08dac6d9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:32:40.778933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0066ac-33f4-4c62-a872-56a08dac6d9e service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:32:40.834697 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a59d-d946-4519-ac0b-615f2dc25e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:32:40.835384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a59d-d946-4519-ac0b-615f2dc25e7e service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:32:40.835668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a59d-d946-4519-ac0b-615f2dc25e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:32:40.835941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a59d-d946-4519-ac0b-615f2dc25e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:32:40.838224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a8f4a59d-d946-4519-ac0b-615f2dc25e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:32:40.905381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4a59d-d946-4519-ac0b-615f2dc25e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:32:40.906841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4a59d-d946-4519-ac0b-615f2dc25e7e service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:32:40.917560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1232/2465] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:32:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:32:50.913022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=50 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:07.917740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692013c-fe4c-462e-8785-ca8f56d5633e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:33:07.917740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692013c-fe4c-462e-8785-ca8f56d5633e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:33:07.918462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692013c-fe4c-462e-8785-ca8f56d5633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:33:07.936864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0692013c-fe4c-462e-8785-ca8f56d5633e None None] MFA Rules not processed for user `d193c0fa3d934ba99e8929b2e2ab65c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:33:07.938179 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0692013c-fe4c-462e-8785-ca8f56d5633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:33:07.997315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1234/2466] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:33:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:33:17.989777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=25 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:33:50.612022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a59d-d946-4519-ac0b-615f2dc25e7e service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:33:50.614057 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a8f4a59d-d946-4519-ac0b-615f2dc25e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:33:50.626126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a59d-d946-4519-ac0b-615f2dc25e7e service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:33:50.630536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c179-1757-4642-b461-34c98711e695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:33:50.631443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c179-1757-4642-b461-34c98711e695 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:33:50.631937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c179-1757-4642-b461-34c98711e695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:33:50.632808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c179-1757-4642-b461-34c98711e695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:33:50.634936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0977c179-1757-4642-b461-34c98711e695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:33:50.729828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977c179-1757-4642-b461-34c98711e695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:33:50.731328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977c179-1757-4642-b461-34c98711e695 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:33:50.753428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1233/2467] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:33:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:33:51.716047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5d8e3-38c3-495c-8b6e-1c752398513a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:33:51.716591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5d8e3-38c3-495c-8b6e-1c752398513a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:33:51.716591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5d8e3-38c3-495c-8b6e-1c752398513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:33:51.735309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-09a5d8e3-38c3-495c-8b6e-1c752398513a None None] MFA Rules not processed for user `5b5a9f5cdfa6494d97617d68880d5552`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:33:51.736577 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-09a5d8e3-38c3-495c-8b6e-1c752398513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:33:51.794567 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1235/2468] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:33:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:33:51.832681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c179-1757-4642-b461-34c98711e695 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:33:51.834233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0977c179-1757-4642-b461-34c98711e695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:33:51.916233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c179-1757-4642-b461-34c98711e695 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:33:51.920500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698f065-eb45-4838-8159-7d1e22a11629 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4adc107bf542b8bb0502c7fbf94431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:33:51.921164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698f065-eb45-4838-8159-7d1e22a11629 service glance] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:33:51.921451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698f065-eb45-4838-8159-7d1e22a11629 service glance] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:33:51.921758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698f065-eb45-4838-8159-7d1e22a11629 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:33:51.923629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f698f065-eb45-4838-8159-7d1e22a11629 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:33:51.938461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698f065-eb45-4838-8159-7d1e22a11629 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:33:51.939884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698f065-eb45-4838-8159-7d1e22a11629 service glance] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:33:51.951638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1234/2469] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:33:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:33:52.564838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5d8e3-38c3-495c-8b6e-1c752398513a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:33:52.566468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-09a5d8e3-38c3-495c-8b6e-1c752398513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:33:52.639858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5d8e3-38c3-495c-8b6e-1c752398513a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:33:52.644793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93ca0e-32f1-4eaa-8387-612b31180600 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:33:52.645462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93ca0e-32f1-4eaa-8387-612b31180600 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:33:52.645748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93ca0e-32f1-4eaa-8387-612b31180600 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:33:52.646023 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93ca0e-32f1-4eaa-8387-612b31180600 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:33:52.647798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7a93ca0e-32f1-4eaa-8387-612b31180600 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:33:52.660300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93ca0e-32f1-4eaa-8387-612b31180600 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:33:52.662253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93ca0e-32f1-4eaa-8387-612b31180600 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:33:52.674169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1236/2470] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:33:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:34:01.946473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=78 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:02.670240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=57 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:10.154051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698f065-eb45-4838-8159-7d1e22a11629 service glance] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:10.163952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698f065-eb45-4838-8159-7d1e22a11629 service glance] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:10.168131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfac90-2ee3-4d6f-ab9e-bee944e5c610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:10.168848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfac90-2ee3-4d6f-ab9e-bee944e5c610 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:10.169109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfac90-2ee3-4d6f-ab9e-bee944e5c610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:10.169380 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfac90-2ee3-4d6f-ab9e-bee944e5c610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:10.171275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c9cfac90-2ee3-4d6f-ab9e-bee944e5c610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:10.181831 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfac90-2ee3-4d6f-ab9e-bee944e5c610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:10.183396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfac90-2ee3-4d6f-ab9e-bee944e5c610 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:10.192022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1235/2471] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:34:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:34:13.938242 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93ca0e-32f1-4eaa-8387-612b31180600 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:13.939706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7a93ca0e-32f1-4eaa-8387-612b31180600 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:13.955479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93ca0e-32f1-4eaa-8387-612b31180600 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:13.961608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf5c2b-46e0-4a2c-8d2d-385cb8d066bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:13.962317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf5c2b-46e0-4a2c-8d2d-385cb8d066bf service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:13.962596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf5c2b-46e0-4a2c-8d2d-385cb8d066bf service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:13.962863 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf5c2b-46e0-4a2c-8d2d-385cb8d066bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:13.964950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-86cf5c2b-46e0-4a2c-8d2d-385cb8d066bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:13.977984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf5c2b-46e0-4a2c-8d2d-385cb8d066bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:13.979619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf5c2b-46e0-4a2c-8d2d-385cb8d066bf service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:13.990783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1237/2472] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:34:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:34:20.130138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfac90-2ee3-4d6f-ab9e-bee944e5c610 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:20.143388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfac90-2ee3-4d6f-ab9e-bee944e5c610 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:20.149344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2361f-a7ed-4a7d-ba4f-6c765eadc235 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:20.150011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2361f-a7ed-4a7d-ba4f-6c765eadc235 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:20.150284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2361f-a7ed-4a7d-ba4f-6c765eadc235 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:20.150558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2361f-a7ed-4a7d-ba4f-6c765eadc235 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:20.152614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b7c2361f-a7ed-4a7d-ba4f-6c765eadc235 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:20.166813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2361f-a7ed-4a7d-ba4f-6c765eadc235 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:20.168754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2361f-a7ed-4a7d-ba4f-6c765eadc235 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:20.179696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1236/2473] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:34:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:34:20.181815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf5c2b-46e0-4a2c-8d2d-385cb8d066bf service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:20.183309 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-86cf5c2b-46e0-4a2c-8d2d-385cb8d066bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:20.250610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf5c2b-46e0-4a2c-8d2d-385cb8d066bf service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:20.255279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:20.256181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:20.256456 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:20.256723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] PATH_INFO: `/v3/users/d193c0fa3d934ba99e8929b2e2ab65c3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:20.257906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d193c0fa3d934ba99e8929b2e2ab65c3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:20.259857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:20.309580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd193c0fa3d934ba99e8929b2e2ab65c3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:34:20.310340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd193c0fa3d934ba99e8929b2e2ab65c3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:34:20.323795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd193c0fa3d934ba99e8929b2e2ab65c3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:34:20.324493 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd193c0fa3d934ba99e8929b2e2ab65c3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:34:20.331659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-ca7bfec0-bbe4-4b25-add2-64054e5b8988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd193c0fa3d934ba99e8929b2e2ab65c3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:34:20.346145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1238/2474] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:34:20 2022] DELETE /identity/v3/users/d193c0fa3d934ba99e8929b2e2ab65c3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:34:20.536396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2361f-a7ed-4a7d-ba4f-6c765eadc235 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:20.550405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2361f-a7ed-4a7d-ba4f-6c765eadc235 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:20.611552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:20.612480 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:20.612764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:20.613037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] PATH_INFO: `/v3/projects/b6ed2dc911c44ea0953b7c849e590a8a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:20.614381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ed2dc911c44ea0953b7c849e590a8a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:20.616349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:20.666937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ed2dc911c44ea0953b7c849e590a8a', 'request_id': 'req-22034f7c-4dc3-45d4-a87d-e3daf7403d27'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:34:20.672649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ed2dc911c44ea0953b7c849e590a8a', 'request_id': 'req-22034f7c-4dc3-45d4-a87d-e3daf7403d27'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:34:20.678704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ed2dc911c44ea0953b7c849e590a8a', 'request_id': 'req-22034f7c-4dc3-45d4-a87d-e3daf7403d27'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:34:20.693261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] The token cache is being invalidate because project b6ed2dc911c44ea0953b7c849e590a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:34:20.693547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:34:20.694214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-22034f7c-4dc3-45d4-a87d-e3daf7403d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:34:20.695827 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1237/2475] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:34:20 2022] DELETE /identity/v3/projects/b6ed2dc911c44ea0953b7c849e590a8a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:34:20.701631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5973938-c2c9-47e1-acb2-b8ea8b66f6e5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:20.702267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5973938-c2c9-47e1-acb2-b8ea8b66f6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:20.702586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5973938-c2c9-47e1-acb2-b8ea8b66f6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:20.722566 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f5973938-c2c9-47e1-acb2-b8ea8b66f6e5 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:34:20.723768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5973938-c2c9-47e1-acb2-b8ea8b66f6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:20.783678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1239/2476] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:34:20.791991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a01577-72db-496e-a9f6-c7b7688a14aa None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:20.792336 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a01577-72db-496e-a9f6-c7b7688a14aa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:20.792638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a01577-72db-496e-a9f6-c7b7688a14aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:20.813678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-55a01577-72db-496e-a9f6-c7b7688a14aa None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:34:20.814913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-55a01577-72db-496e-a9f6-c7b7688a14aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:20.824786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1238/2477] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:34:20.829300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5973938-c2c9-47e1-acb2-b8ea8b66f6e5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:20.839812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5973938-c2c9-47e1-acb2-b8ea8b66f6e5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:20.847400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45aca2-a0ac-438f-aefd-3e67f49bfe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:20.848356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45aca2-a0ac-438f-aefd-3e67f49bfe48 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:20.848662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45aca2-a0ac-438f-aefd-3e67f49bfe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:20.848945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45aca2-a0ac-438f-aefd-3e67f49bfe48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:20.850043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45aca2-a0ac-438f-aefd-3e67f49bfe48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:34:20.850448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45aca2-a0ac-438f-aefd-3e67f49bfe48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:20.853038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45aca2-a0ac-438f-aefd-3e67f49bfe48 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:20.855262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:20.871008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1240/2478] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:34:20.875541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a01577-72db-496e-a9f6-c7b7688a14aa None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:20.885327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a01577-72db-496e-a9f6-c7b7688a14aa None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:20.890795 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b449047-1771-4bff-bcad-0fd9888169be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:20.891448 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b449047-1771-4bff-bcad-0fd9888169be admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:20.891734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b449047-1771-4bff-bcad-0fd9888169be admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:20.891990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b449047-1771-4bff-bcad-0fd9888169be admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:20.892794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b449047-1771-4bff-bcad-0fd9888169be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:20.894706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b449047-1771-4bff-bcad-0fd9888169be admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:20.926453 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1239/2479] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:34:20 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:34:20.930657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45aca2-a0ac-438f-aefd-3e67f49bfe48 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:20.941207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45aca2-a0ac-438f-aefd-3e67f49bfe48 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:21.001516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320acf09-a3d4-4527-b0a9-4ad6f896d311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:21.002195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320acf09-a3d4-4527-b0a9-4ad6f896d311 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:21.002471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320acf09-a3d4-4527-b0a9-4ad6f896d311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:21.002739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320acf09-a3d4-4527-b0a9-4ad6f896d311 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:21.003471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320acf09-a3d4-4527-b0a9-4ad6f896d311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:21.005502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320acf09-a3d4-4527-b0a9-4ad6f896d311 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:21.033913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1241/2480] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:34:20 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:34:21.038998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b449047-1771-4bff-bcad-0fd9888169be admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:21.055995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b449047-1771-4bff-bcad-0fd9888169be admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:21.063052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d33e56-db69-4c84-902d-2c4d6bb31c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:21.063721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d33e56-db69-4c84-902d-2c4d6bb31c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:21.064031 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d33e56-db69-4c84-902d-2c4d6bb31c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:21.064316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d33e56-db69-4c84-902d-2c4d6bb31c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:21.065056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d33e56-db69-4c84-902d-2c4d6bb31c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:21.066691 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d33e56-db69-4c84-902d-2c4d6bb31c44 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:21.077303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1240/2481] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:34:21.082884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320acf09-a3d4-4527-b0a9-4ad6f896d311 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:21.093919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320acf09-a3d4-4527-b0a9-4ad6f896d311 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:21.099653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13387-1b58-42b7-9e9e-c062f43812a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:21.100461 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13387-1b58-42b7-9e9e-c062f43812a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:21.100865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13387-1b58-42b7-9e9e-c062f43812a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:21.101148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13387-1b58-42b7-9e9e-c062f43812a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:21.101894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13387-1b58-42b7-9e9e-c062f43812a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:21.103686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13387-1b58-42b7-9e9e-c062f43812a1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:21.117067 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1242/2482] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:34:21.121713 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d33e56-db69-4c84-902d-2c4d6bb31c44 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:21.132624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d33e56-db69-4c84-902d-2c4d6bb31c44 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:21.137752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256272e-59c2-4743-bfca-9b5256efbb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:21.138890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256272e-59c2-4743-bfca-9b5256efbb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:21.139030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256272e-59c2-4743-bfca-9b5256efbb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:21.139226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256272e-59c2-4743-bfca-9b5256efbb20 admin admin] PATH_INFO: `/v3/projects/2829dcddd2864698b273038b8df5ce76/users/cf94c76ba04b403b91a7ff77a2f476e8/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:21.155405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256272e-59c2-4743-bfca-9b5256efbb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2829dcddd2864698b273038b8df5ce76, user_id=cf94c76ba04b403b91a7ff77a2f476e8, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:21.158101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256272e-59c2-4743-bfca-9b5256efbb20 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:21.168578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:21.173836 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1241/2483] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:34:21 2022] PUT /identity/v3/projects/2829dcddd2864698b273038b8df5ce76/users/cf94c76ba04b403b91a7ff77a2f476e8/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:34:21.179148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fd09c-fde1-4ae0-addd-8274cea852d4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:21.179403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fd09c-fde1-4ae0-addd-8274cea852d4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:21.179671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fd09c-fde1-4ae0-addd-8274cea852d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:21.197777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c59fd09c-fde1-4ae0-addd-8274cea852d4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:34:21.198974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c59fd09c-fde1-4ae0-addd-8274cea852d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:21.260924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1243/2484] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:34:21.270963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256272e-59c2-4743-bfca-9b5256efbb20 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:21.273623 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1256272e-59c2-4743-bfca-9b5256efbb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:21.347454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256272e-59c2-4743-bfca-9b5256efbb20 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:21.351673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41a5dc-3577-4812-a5aa-b4d22e7ef91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:21.352377 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41a5dc-3577-4812-a5aa-b4d22e7ef91b service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:21.352668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41a5dc-3577-4812-a5aa-b4d22e7ef91b service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:21.352933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41a5dc-3577-4812-a5aa-b4d22e7ef91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:21.363391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41a5dc-3577-4812-a5aa-b4d22e7ef91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:21.364897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41a5dc-3577-4812-a5aa-b4d22e7ef91b service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:21.374777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1242/2485] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:34:25.371973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faceda-6f8c-4bac-96e2-84405afc2bb9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:25.373049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faceda-6f8c-4bac-96e2-84405afc2bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:25.373529 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faceda-6f8c-4bac-96e2-84405afc2bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:25.409843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-49faceda-6f8c-4bac-96e2-84405afc2bb9 None None] MFA Rules not processed for user `cf94c76ba04b403b91a7ff77a2f476e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:34:25.412826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-49faceda-6f8c-4bac-96e2-84405afc2bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:25.486690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1244/2486] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:34:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:34:25.491335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41a5dc-3577-4812-a5aa-b4d22e7ef91b service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:25.502593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41a5dc-3577-4812-a5aa-b4d22e7ef91b service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:25.508290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d55213-e0e2-421a-9c7a-666f01fea279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:25.509441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d55213-e0e2-421a-9c7a-666f01fea279 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:25.509789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d55213-e0e2-421a-9c7a-666f01fea279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:25.510234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d55213-e0e2-421a-9c7a-666f01fea279 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:25.511122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d55213-e0e2-421a-9c7a-666f01fea279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:25.513498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d55213-e0e2-421a-9c7a-666f01fea279 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:25.553437 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1243/2487] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:34:25 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:34:25.555079 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faceda-6f8c-4bac-96e2-84405afc2bb9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:25.561609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:25.574832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faceda-6f8c-4bac-96e2-84405afc2bb9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:25.634465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce391bb-5827-4dbb-ae53-825e0dc3be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:25.635157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce391bb-5827-4dbb-ae53-825e0dc3be26 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:25.635457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce391bb-5827-4dbb-ae53-825e0dc3be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:25.635731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce391bb-5827-4dbb-ae53-825e0dc3be26 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:25.636511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce391bb-5827-4dbb-ae53-825e0dc3be26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:25.638577 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce391bb-5827-4dbb-ae53-825e0dc3be26 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:25.663101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1245/2488] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:34:25 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:34:25.667299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d55213-e0e2-421a-9c7a-666f01fea279 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:25.678643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d55213-e0e2-421a-9c7a-666f01fea279 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:25.683259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460faa8-5329-4581-a70c-b209440a5989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:25.684199 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460faa8-5329-4581-a70c-b209440a5989 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:25.684485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460faa8-5329-4581-a70c-b209440a5989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:25.684758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460faa8-5329-4581-a70c-b209440a5989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:25.685554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460faa8-5329-4581-a70c-b209440a5989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:25.687361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460faa8-5329-4581-a70c-b209440a5989 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:25.698922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1244/2489] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:34:25.703308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce391bb-5827-4dbb-ae53-825e0dc3be26 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:25.713758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce391bb-5827-4dbb-ae53-825e0dc3be26 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:25.719266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d07f5-458d-4b41-8181-b077b3d268a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:25.720220 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d07f5-458d-4b41-8181-b077b3d268a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:25.720506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d07f5-458d-4b41-8181-b077b3d268a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:25.720783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d07f5-458d-4b41-8181-b077b3d268a1 admin admin] PATH_INFO: `/v3/projects/93cb36d427514775934bfee90e3103ac/users/f7d53c86a3034809bb5ed8f6203ab15e/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:25.738062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d07f5-458d-4b41-8181-b077b3d268a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93cb36d427514775934bfee90e3103ac, user_id=f7d53c86a3034809bb5ed8f6203ab15e, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:25.740841 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d07f5-458d-4b41-8181-b077b3d268a1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:25.757263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1246/2490] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:34:25 2022] PUT /identity/v3/projects/93cb36d427514775934bfee90e3103ac/users/f7d53c86a3034809bb5ed8f6203ab15e/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:34:25.761255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460faa8-5329-4581-a70c-b209440a5989 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:25.771947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460faa8-5329-4581-a70c-b209440a5989 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:25.838164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d686bb2-d748-4f9d-9db2-0cc51a7c367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:25.838841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686bb2-d748-4f9d-9db2-0cc51a7c367c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:25.839120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686bb2-d748-4f9d-9db2-0cc51a7c367c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:25.839393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686bb2-d748-4f9d-9db2-0cc51a7c367c admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:25.840158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d686bb2-d748-4f9d-9db2-0cc51a7c367c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:25.841819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d686bb2-d748-4f9d-9db2-0cc51a7c367c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:25.852861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1245/2491] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:34:25.857243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d07f5-458d-4b41-8181-b077b3d268a1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:25.868027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d07f5-458d-4b41-8181-b077b3d268a1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:25.873052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053338b4-c260-45b3-989b-ab165180657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:25.873944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053338b4-c260-45b3-989b-ab165180657f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:25.874224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053338b4-c260-45b3-989b-ab165180657f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:25.874523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053338b4-c260-45b3-989b-ab165180657f admin admin] PATH_INFO: `/v3/projects/93cb36d427514775934bfee90e3103ac/users/f7d53c86a3034809bb5ed8f6203ab15e/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:25.876775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053338b4-c260-45b3-989b-ab165180657f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93cb36d427514775934bfee90e3103ac, user_id=f7d53c86a3034809bb5ed8f6203ab15e, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:25.879590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053338b4-c260-45b3-989b-ab165180657f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:25.890186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1247/2492] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:34:25 2022] PUT /identity/v3/projects/93cb36d427514775934bfee90e3103ac/users/f7d53c86a3034809bb5ed8f6203ab15e/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:34:27.349065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d686bb2-d748-4f9d-9db2-0cc51a7c367c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:27.351393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8d686bb2-d748-4f9d-9db2-0cc51a7c367c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:27.426983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:27.432189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d686bb2-d748-4f9d-9db2-0cc51a7c367c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:27.506834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95658d89-852b-4061-943e-02e15b3d83e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:27.507521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95658d89-852b-4061-943e-02e15b3d83e3 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:27.507807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95658d89-852b-4061-943e-02e15b3d83e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:27.508114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95658d89-852b-4061-943e-02e15b3d83e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:27.509950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-95658d89-852b-4061-943e-02e15b3d83e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:27.574529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95658d89-852b-4061-943e-02e15b3d83e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:27.576253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95658d89-852b-4061-943e-02e15b3d83e3 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:27.587247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1246/2493] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:34:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:34:30.606315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d0d2-e88a-4bab-99b4-4ee9d325f79d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:30.606940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d0d2-e88a-4bab-99b4-4ee9d325f79d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:30.606940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d0d2-e88a-4bab-99b4-4ee9d325f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:30.640761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-19f3d0d2-e88a-4bab-99b4-4ee9d325f79d None None] MFA Rules not processed for user `f7d53c86a3034809bb5ed8f6203ab15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:34:30.641983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-19f3d0d2-e88a-4bab-99b4-4ee9d325f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:30.733471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1248/2494] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:34:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:34:30.751426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95658d89-852b-4061-943e-02e15b3d83e3 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:30.753424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-95658d89-852b-4061-943e-02e15b3d83e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:30.768910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95658d89-852b-4061-943e-02e15b3d83e3 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:30.775339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa4eee-acd2-4beb-8cc8-14e848a06b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:30.776327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4eee-acd2-4beb-8cc8-14e848a06b4d service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:30.776684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4eee-acd2-4beb-8cc8-14e848a06b4d service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:30.777034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4eee-acd2-4beb-8cc8-14e848a06b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:30.843446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa4eee-acd2-4beb-8cc8-14e848a06b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:30.845532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa4eee-acd2-4beb-8cc8-14e848a06b4d service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:30.854505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1247/2495] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:34:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:34:40.517273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d0d2-e88a-4bab-99b4-4ee9d325f79d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:40.534500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d0d2-e88a-4bab-99b4-4ee9d325f79d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:40.541252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78760ec-6379-498d-8781-3826bc7a8afc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:40.541914 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78760ec-6379-498d-8781-3826bc7a8afc service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:40.542195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78760ec-6379-498d-8781-3826bc7a8afc service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:40.542467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78760ec-6379-498d-8781-3826bc7a8afc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:40.544501 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e78760ec-6379-498d-8781-3826bc7a8afc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:40.588796 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:40.615228 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78760ec-6379-498d-8781-3826bc7a8afc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:40.616872 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78760ec-6379-498d-8781-3826bc7a8afc service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:40.627877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1249/2496] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:34:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:34:40.850474 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=82 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:50.623379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:34:54.627450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57034-d1e3-4930-8776-b5cf052b5a30 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:54.628034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57034-d1e3-4930-8776-b5cf052b5a30 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:54.628034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e57034-d1e3-4930-8776-b5cf052b5a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:54.646066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b2e57034-d1e3-4930-8776-b5cf052b5a30 None None] MFA Rules not processed for user `cf94c76ba04b403b91a7ff77a2f476e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:34:54.647281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b2e57034-d1e3-4930-8776-b5cf052b5a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:54.655101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1248/2497] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:34:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:34:54.984181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78760ec-6379-498d-8781-3826bc7a8afc service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:34:55.042059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78760ec-6379-498d-8781-3826bc7a8afc service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:34:55.045646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fd86f-6196-43e4-ac6f-610064c752ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:34:55.046332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fd86f-6196-43e4-ac6f-610064c752ca service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:34:55.046617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fd86f-6196-43e4-ac6f-610064c752ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:34:55.046888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fd86f-6196-43e4-ac6f-610064c752ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:34:55.048671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-155fd86f-6196-43e4-ac6f-610064c752ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:34:55.059723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fd86f-6196-43e4-ac6f-610064c752ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:34:55.061205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fd86f-6196-43e4-ac6f-610064c752ca service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:34:55.069554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1250/2498] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:34:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:35:01.152065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b093c-8dd7-4439-807f-e65d3dae4209 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:35:01.152638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b093c-8dd7-4439-807f-e65d3dae4209 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:35:01.152638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b093c-8dd7-4439-807f-e65d3dae4209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:35:01.173985 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fc4b093c-8dd7-4439-807f-e65d3dae4209 None None] MFA Rules not processed for user `30f3cc8f3f964b96b864fc8a7f86481a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:35:01.175790 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fc4b093c-8dd7-4439-807f-e65d3dae4209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:35:01.186204 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1249/2499] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:35:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:35:05.065849 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=26 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:07.901169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fd86f-6196-43e4-ac6f-610064c752ca service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:35:07.918386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fd86f-6196-43e4-ac6f-610064c752ca service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:35:07.927455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03e957-ba64-4aea-9f45-b2284e502860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:35:07.928183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03e957-ba64-4aea-9f45-b2284e502860 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:35:07.928435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03e957-ba64-4aea-9f45-b2284e502860 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:35:07.928742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03e957-ba64-4aea-9f45-b2284e502860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:35:07.930606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9c03e957-ba64-4aea-9f45-b2284e502860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:35:07.943659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03e957-ba64-4aea-9f45-b2284e502860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:35:07.945306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03e957-ba64-4aea-9f45-b2284e502860 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:35:07.956363 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1251/2500] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:35:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:35:11.167970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:13.997659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b093c-8dd7-4439-807f-e65d3dae4209 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:35:14.012728 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b093c-8dd7-4439-807f-e65d3dae4209 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:35:14.018563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5bbf0-d97d-461b-a41d-824b24e6c04a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:35:14.019216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5bbf0-d97d-461b-a41d-824b24e6c04a service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:35:14.019493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5bbf0-d97d-461b-a41d-824b24e6c04a service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:35:14.019768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5bbf0-d97d-461b-a41d-824b24e6c04a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:35:14.021772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8eb5bbf0-d97d-461b-a41d-824b24e6c04a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:35:14.034196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5bbf0-d97d-461b-a41d-824b24e6c04a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:35:14.036267 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5bbf0-d97d-461b-a41d-824b24e6c04a service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:35:14.047220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1250/2501] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:35:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:35:17.069812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03e957-ba64-4aea-9f45-b2284e502860 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:35:17.071446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9c03e957-ba64-4aea-9f45-b2284e502860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:35:17.083995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03e957-ba64-4aea-9f45-b2284e502860 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:35:17.088345 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695e870-7c69-48e2-9686-806d2a6c3b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:35:17.088989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695e870-7c69-48e2-9686-806d2a6c3b17 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:35:17.089269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695e870-7c69-48e2-9686-806d2a6c3b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:35:17.089540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695e870-7c69-48e2-9686-806d2a6c3b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:35:17.100094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695e870-7c69-48e2-9686-806d2a6c3b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:35:17.101528 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695e870-7c69-48e2-9686-806d2a6c3b17 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:35:17.111043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1252/2502] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:35:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:35:24.043575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:27.107017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=12 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:43.509064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5bbf0-d97d-461b-a41d-824b24e6c04a service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:35:43.522896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5bbf0-d97d-461b-a41d-824b24e6c04a service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:35:43.529219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce56f3-65b8-4773-a975-d8afe16bb8c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:35:43.529877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce56f3-65b8-4773-a975-d8afe16bb8c1 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:35:43.530164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce56f3-65b8-4773-a975-d8afe16bb8c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:35:43.530435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce56f3-65b8-4773-a975-d8afe16bb8c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:35:43.532619 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c6ce56f3-65b8-4773-a975-d8afe16bb8c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:35:43.593960 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce56f3-65b8-4773-a975-d8afe16bb8c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:35:43.595529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce56f3-65b8-4773-a975-d8afe16bb8c1 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:35:43.604855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1251/2503] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:35:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:35:53.600478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=28 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:35:55.416396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9453a-6d18-40c6-b933-834847e4c41b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:35:55.416979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9453a-6d18-40c6-b933-834847e4c41b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:35:55.416979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9453a-6d18-40c6-b933-834847e4c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:35:55.436389 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-13f9453a-6d18-40c6-b933-834847e4c41b None None] MFA Rules not processed for user `5b5a9f5cdfa6494d97617d68880d5552`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:35:55.437995 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-13f9453a-6d18-40c6-b933-834847e4c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:35:55.445835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1253/2504] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:35:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:36:05.430661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:13.307327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326104f-1bbd-464c-bec9-84962d34ef96 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:13.307782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326104f-1bbd-464c-bec9-84962d34ef96 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:13.307874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326104f-1bbd-464c-bec9-84962d34ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:13.326546 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0326104f-1bbd-464c-bec9-84962d34ef96 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:36:13.327746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0326104f-1bbd-464c-bec9-84962d34ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:13.386361 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1252/2505] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 4 18:36:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:36:13.426393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9453a-6d18-40c6-b933-834847e4c41b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:13.427896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-13f9453a-6d18-40c6-b933-834847e4c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:13.519981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9453a-6d18-40c6-b933-834847e4c41b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:13.525922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f620b-4531-47be-9c12-99af8cbd2707 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:13.526596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f620b-4531-47be-9c12-99af8cbd2707 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:13.526884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f620b-4531-47be-9c12-99af8cbd2707 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:13.527164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f620b-4531-47be-9c12-99af8cbd2707 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:13.536624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f620b-4531-47be-9c12-99af8cbd2707 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:13.538303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f620b-4531-47be-9c12-99af8cbd2707 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:13.546676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1254/2506] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:36:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 18:36:19.008111 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a46f3-311a-4bd0-afee-191ef1a251aa None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:19.008640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a46f3-311a-4bd0-afee-191ef1a251aa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:19.008640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a46f3-311a-4bd0-afee-191ef1a251aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:19.026247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b03a46f3-311a-4bd0-afee-191ef1a251aa None None] MFA Rules not processed for user `bbb6c8f984d645dda88e2744f62a5213`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:36:19.027455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b03a46f3-311a-4bd0-afee-191ef1a251aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:19.034903 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1253/2507] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:36:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:36:19.436184 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f620b-4531-47be-9c12-99af8cbd2707 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:19.445856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f620b-4531-47be-9c12-99af8cbd2707 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:19.449490 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28262e51-6251-43f6-9e01-22935f323184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:19.450425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28262e51-6251-43f6-9e01-22935f323184 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:19.450783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28262e51-6251-43f6-9e01-22935f323184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:19.451139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28262e51-6251-43f6-9e01-22935f323184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:19.453056 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-28262e51-6251-43f6-9e01-22935f323184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:19.463668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28262e51-6251-43f6-9e01-22935f323184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:19.465491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28262e51-6251-43f6-9e01-22935f323184 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:19.474560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1255/2508] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:36:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:36:22.515170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a46f3-311a-4bd0-afee-191ef1a251aa None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:22.517717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b03a46f3-311a-4bd0-afee-191ef1a251aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:22.648170 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28262e51-6251-43f6-9e01-22935f323184 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:22.650411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-28262e51-6251-43f6-9e01-22935f323184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:22.656388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a46f3-311a-4bd0-afee-191ef1a251aa None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:22.678891 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a508711-afec-4fd6-b929-7e4d67706cbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:22.680219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508711-afec-4fd6-b929-7e4d67706cbb service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:22.680721 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508711-afec-4fd6-b929-7e4d67706cbb service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:22.681198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508711-afec-4fd6-b929-7e4d67706cbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:22.684598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8a508711-afec-4fd6-b929-7e4d67706cbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:22.715673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a508711-afec-4fd6-b929-7e4d67706cbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:22.717905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a508711-afec-4fd6-b929-7e4d67706cbb service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:22.733981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1254/2509] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:36:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:36:22.775791 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28262e51-6251-43f6-9e01-22935f323184 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:22.782425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:22.783627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:22.784500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:22.785001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] PATH_INFO: `/v3/users/2e0bd04828eb48bdbfe09fd01130ac73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:22.786526 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0bd04828eb48bdbfe09fd01130ac73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:22.790116 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:22.872345 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0bd04828eb48bdbfe09fd01130ac73'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:22.873196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0bd04828eb48bdbfe09fd01130ac73'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:22.893412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0bd04828eb48bdbfe09fd01130ac73'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:22.895123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0bd04828eb48bdbfe09fd01130ac73'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:22.898710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:22.907741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0bd04828eb48bdbfe09fd01130ac73'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:22.936925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1256/2510] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:36:22 2022] DELETE /identity/v3/users/2e0bd04828eb48bdbfe09fd01130ac73 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:36:23.265425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a508711-afec-4fd6-b929-7e4d67706cbb service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:23.311624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a508711-afec-4fd6-b929-7e4d67706cbb service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:23.430777 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:23.431703 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:23.431990 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:23.432293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] PATH_INFO: `/v3/projects/5cfb3750227e4037b6e92552361366f4` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:23.435245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cfb3750227e4037b6e92552361366f4)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:23.437242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:23.525297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:23.557801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cfb3750227e4037b6e92552361366f4', 'request_id': 'req-c034dc05-1307-43c1-b3b8-f9a0bba12f89'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:23.569366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cfb3750227e4037b6e92552361366f4', 'request_id': 'req-c034dc05-1307-43c1-b3b8-f9a0bba12f89'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:23.577626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cfb3750227e4037b6e92552361366f4', 'request_id': 'req-c034dc05-1307-43c1-b3b8-f9a0bba12f89'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:23.602134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] The token cache is being invalidate because project 5cfb3750227e4037b6e92552361366f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:36:23.602497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:23.603211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:23.605353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1255/2511] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:36:23 2022] DELETE /identity/v3/projects/5cfb3750227e4037b6e92552361366f4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:36:23.609804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:23.611829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:23.633020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8a438-5a92-4239-977b-cb3da71097ff admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:23.761835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:23.763293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:23.763852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:23.764457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] PATH_INFO: `/v3/users/955cdc78d512491d85220fe7dc8e764b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:23.766404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=955cdc78d512491d85220fe7dc8e764b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:23.770474 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:23.841721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955cdc78d512491d85220fe7dc8e764b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:23.842447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955cdc78d512491d85220fe7dc8e764b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:23.859600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955cdc78d512491d85220fe7dc8e764b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:23.860577 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955cdc78d512491d85220fe7dc8e764b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:23.870685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955cdc78d512491d85220fe7dc8e764b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:23.888343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1257/2512] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:36:23 2022] DELETE /identity/v3/users/955cdc78d512491d85220fe7dc8e764b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:36:24.074671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:24.085833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:24.102730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034dc05-1307-43c1-b3b8-f9a0bba12f89 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:24.165789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:24.166670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:24.166985 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:24.167295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] PATH_INFO: `/v3/projects/b2310b63331c4b9ea9d68e9ceaaf866e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:24.168523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2310b63331c4b9ea9d68e9ceaaf866e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:24.170454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:24.217163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2310b63331c4b9ea9d68e9ceaaf866e', 'request_id': 'req-fa01e89c-7d74-4930-89de-6298579b6fff'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:24.222695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2310b63331c4b9ea9d68e9ceaaf866e', 'request_id': 'req-fa01e89c-7d74-4930-89de-6298579b6fff'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:24.228889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2310b63331c4b9ea9d68e9ceaaf866e', 'request_id': 'req-fa01e89c-7d74-4930-89de-6298579b6fff'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:24.243298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] The token cache is being invalidate because project b2310b63331c4b9ea9d68e9ceaaf866e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:36:24.243582 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:24.244241 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:24.245834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1256/2513] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:36:24 2022] DELETE /identity/v3/projects/b2310b63331c4b9ea9d68e9ceaaf866e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:36:30.829576 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:30.832201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:30.900046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58bde0-2d06-4f88-8909-c07b6e0d2b81 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:30.918778 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:30.956829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8d626-9ba6-4f0d-ac5e-1d4014fadb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:30.957488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8d626-9ba6-4f0d-ac5e-1d4014fadb5b service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:30.957770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8d626-9ba6-4f0d-ac5e-1d4014fadb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:30.958039 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8d626-9ba6-4f0d-ac5e-1d4014fadb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:30.960492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f7d8d626-9ba6-4f0d-ac5e-1d4014fadb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:31.026003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8d626-9ba6-4f0d-ac5e-1d4014fadb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:31.027452 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8d626-9ba6-4f0d-ac5e-1d4014fadb5b service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:31.038660 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1258/2514] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:36:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:36:34.240513 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:34.417223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:34.419723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:34.437458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e89c-7d74-4930-89de-6298579b6fff admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:34.443629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:34.446584 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:34.447045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:34.447539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] PATH_INFO: `/v3/users/30f3cc8f3f964b96b864fc8a7f86481a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:34.449293 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f3cc8f3f964b96b864fc8a7f86481a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:34.451497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:34.526880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f3cc8f3f964b96b864fc8a7f86481a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:34.542806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f3cc8f3f964b96b864fc8a7f86481a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:34.552711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f3cc8f3f964b96b864fc8a7f86481a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:34.561006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f3cc8f3f964b96b864fc8a7f86481a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:34.561674 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-17a77503-cd2c-4399-8a23-55761b333ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f3cc8f3f964b96b864fc8a7f86481a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:34.568984 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1257/2515] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:36:34 2022] DELETE /identity/v3/users/30f3cc8f3f964b96b864fc8a7f86481a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:36:34.758606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8d626-9ba6-4f0d-ac5e-1d4014fadb5b service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:34.769214 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8d626-9ba6-4f0d-ac5e-1d4014fadb5b service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:34.835542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:34.836515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:34.836796 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:34.837069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] PATH_INFO: `/v3/projects/a3c5011d10ed45c68dcfe77a09f6d9a1` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:34.838483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c5011d10ed45c68dcfe77a09f6d9a1)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:34.840465 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:34.900410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'request_id': 'req-65a2c6ac-62d1-460b-b4fb-050593d0f701'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:34.912381 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'request_id': 'req-65a2c6ac-62d1-460b-b4fb-050593d0f701'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:34.919840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c5011d10ed45c68dcfe77a09f6d9a1', 'request_id': 'req-65a2c6ac-62d1-460b-b4fb-050593d0f701'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:34.927721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:34.931942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] The token cache is being invalidate because project a3c5011d10ed45c68dcfe77a09f6d9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:36:34.932488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:34.933274 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65a2c6ac-62d1-460b-b4fb-050593d0f701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:36:34.935454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1259/2516] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:36:34 2022] DELETE /identity/v3/projects/a3c5011d10ed45c68dcfe77a09f6d9a1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:36:34.941765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc1430-eac9-4be0-8e64-769a58f08989 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:34.942073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc1430-eac9-4be0-8e64-769a58f08989 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:34.942334 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc1430-eac9-4be0-8e64-769a58f08989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:34.961366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-85fc1430-eac9-4be0-8e64-769a58f08989 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:36:34.962520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-85fc1430-eac9-4be0-8e64-769a58f08989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:35.027080 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1258/2517] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:36:35.034971 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84da6-013d-4f4c-8504-86879cdc40f1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:35.035275 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84da6-013d-4f4c-8504-86879cdc40f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:35.035559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84da6-013d-4f4c-8504-86879cdc40f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:35.054257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-92f84da6-013d-4f4c-8504-86879cdc40f1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:36:35.055450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-92f84da6-013d-4f4c-8504-86879cdc40f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:35.063575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1260/2518] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:36:35.067646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc1430-eac9-4be0-8e64-769a58f08989 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:35.077354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc1430-eac9-4be0-8e64-769a58f08989 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:35.082063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823800f-5e1e-4592-a343-673a3f71507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:35.082723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823800f-5e1e-4592-a343-673a3f71507e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:35.083003 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823800f-5e1e-4592-a343-673a3f71507e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:35.083275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823800f-5e1e-4592-a343-673a3f71507e admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:35.084022 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823800f-5e1e-4592-a343-673a3f71507e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:36:35.084344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823800f-5e1e-4592-a343-673a3f71507e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:35.086000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823800f-5e1e-4592-a343-673a3f71507e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:35.098123 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1259/2519] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:36:35.102690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f84da6-013d-4f4c-8504-86879cdc40f1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:35.112372 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f84da6-013d-4f4c-8504-86879cdc40f1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:35.118850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9428-b244-43ff-aa31-d32507d3c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:35.119772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9428-b244-43ff-aa31-d32507d3c1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:35.120098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9428-b244-43ff-aa31-d32507d3c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:35.120357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9428-b244-43ff-aa31-d32507d3c1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:35.121196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf9428-b244-43ff-aa31-d32507d3c1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:35.123159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf9428-b244-43ff-aa31-d32507d3c1c3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:35.162791 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1261/2520] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:36:35 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:36:35.167294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823800f-5e1e-4592-a343-673a3f71507e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:35.178481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823800f-5e1e-4592-a343-673a3f71507e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:35.243954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce76c27-f2f1-4db0-ab46-11336b93a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:35.244704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce76c27-f2f1-4db0-ab46-11336b93a516 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:35.244979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce76c27-f2f1-4db0-ab46-11336b93a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:35.245430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce76c27-f2f1-4db0-ab46-11336b93a516 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:35.245959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce76c27-f2f1-4db0-ab46-11336b93a516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:35.247926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce76c27-f2f1-4db0-ab46-11336b93a516 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:35.254892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:35.275211 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1260/2521] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:36:35 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:36:35.279320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9428-b244-43ff-aa31-d32507d3c1c3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:35.290874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9428-b244-43ff-aa31-d32507d3c1c3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:35.297438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e3418-07b2-4ecc-9c7e-a531ad4875d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:35.298119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e3418-07b2-4ecc-9c7e-a531ad4875d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:35.298400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e3418-07b2-4ecc-9c7e-a531ad4875d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:35.298673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e3418-07b2-4ecc-9c7e-a531ad4875d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:35.299403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e3418-07b2-4ecc-9c7e-a531ad4875d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:35.301120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e3418-07b2-4ecc-9c7e-a531ad4875d0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:35.322321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1262/2522] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:36:35.326792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce76c27-f2f1-4db0-ab46-11336b93a516 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:35.337268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce76c27-f2f1-4db0-ab46-11336b93a516 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:35.342156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c553fd-1925-4274-9ad8-638378e685b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:35.342867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c553fd-1925-4274-9ad8-638378e685b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:35.343148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c553fd-1925-4274-9ad8-638378e685b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:35.343418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c553fd-1925-4274-9ad8-638378e685b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:35.344287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c553fd-1925-4274-9ad8-638378e685b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:35.345962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c553fd-1925-4274-9ad8-638378e685b4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:35.357339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1261/2523] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:36:35.361380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e3418-07b2-4ecc-9c7e-a531ad4875d0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:35.372316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e3418-07b2-4ecc-9c7e-a531ad4875d0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:35.379942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf081260-bafa-454c-9f5c-6b0ca3b0eb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:35.380891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf081260-bafa-454c-9f5c-6b0ca3b0eb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:35.382174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf081260-bafa-454c-9f5c-6b0ca3b0eb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:35.382579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf081260-bafa-454c-9f5c-6b0ca3b0eb6d admin admin] PATH_INFO: `/v3/projects/1c1a5168618d4511a41baa4f25425b86/users/6ceccf3f6ce044b98503b09b13cd2510/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:35.399511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf081260-bafa-454c-9f5c-6b0ca3b0eb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1a5168618d4511a41baa4f25425b86, user_id=6ceccf3f6ce044b98503b09b13cd2510, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:35.402245 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf081260-bafa-454c-9f5c-6b0ca3b0eb6d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:35.417851 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1263/2524] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:36:35 2022] PUT /identity/v3/projects/1c1a5168618d4511a41baa4f25425b86/users/6ceccf3f6ce044b98503b09b13cd2510/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:36:35.423297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07df7d-bf55-4ce8-aa1f-f0ee597d696b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:35.423586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07df7d-bf55-4ce8-aa1f-f0ee597d696b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:35.423885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07df7d-bf55-4ce8-aa1f-f0ee597d696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:35.442052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4a07df7d-bf55-4ce8-aa1f-f0ee597d696b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:36:35.443365 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4a07df7d-bf55-4ce8-aa1f-f0ee597d696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:35.503197 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1262/2525] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:36:35.513222 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf081260-bafa-454c-9f5c-6b0ca3b0eb6d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:35.514969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bf081260-bafa-454c-9f5c-6b0ca3b0eb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:35.578297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf081260-bafa-454c-9f5c-6b0ca3b0eb6d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:35.582048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4274b31-8659-4570-919e-77b903ec4309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:35.582709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4274b31-8659-4570-919e-77b903ec4309 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:35.582992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4274b31-8659-4570-919e-77b903ec4309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:35.583272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4274b31-8659-4570-919e-77b903ec4309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:35.594033 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4274b31-8659-4570-919e-77b903ec4309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:35.595482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4274b31-8659-4570-919e-77b903ec4309 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:35.606619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1264/2526] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:36:39.810742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cff83-0de9-4198-8e0d-3bd7b3fce60a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:39.811263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cff83-0de9-4198-8e0d-3bd7b3fce60a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:39.811439 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cff83-0de9-4198-8e0d-3bd7b3fce60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:39.841741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0d8cff83-0de9-4198-8e0d-3bd7b3fce60a None None] MFA Rules not processed for user `6ceccf3f6ce044b98503b09b13cd2510`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:36:39.843044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0d8cff83-0de9-4198-8e0d-3bd7b3fce60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:39.913731 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1263/2527] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:36:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:36:39.929331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4274b31-8659-4570-919e-77b903ec4309 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:39.930803 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a4274b31-8659-4570-919e-77b903ec4309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:40.007393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4274b31-8659-4570-919e-77b903ec4309 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:40.013026 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999589c-f36b-4a97-bb4d-c181dae96142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:40.013690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999589c-f36b-4a97-bb4d-c181dae96142 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:40.013975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999589c-f36b-4a97-bb4d-c181dae96142 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:40.014254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999589c-f36b-4a97-bb4d-c181dae96142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:40.022387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999589c-f36b-4a97-bb4d-c181dae96142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:40.023997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999589c-f36b-4a97-bb4d-c181dae96142 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:40.032736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1265/2528] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:36:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:36:41.359544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b40df-66eb-481d-bbda-3bc3fc5c5503 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:41.360068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b40df-66eb-481d-bbda-3bc3fc5c5503 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:41.360156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b40df-66eb-481d-bbda-3bc3fc5c5503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:41.377756 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-841b40df-66eb-481d-bbda-3bc3fc5c5503 None None] MFA Rules not processed for user `6ceccf3f6ce044b98503b09b13cd2510`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:36:41.378994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-841b40df-66eb-481d-bbda-3bc3fc5c5503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:41.386259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1264/2529] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:36:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:36:50.029105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:51.372732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:36:59.371269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999589c-f36b-4a97-bb4d-c181dae96142 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:36:59.372795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b999589c-f36b-4a97-bb4d-c181dae96142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:59.454209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999589c-f36b-4a97-bb4d-c181dae96142 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:36:59.460702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee89254-d349-423b-82c8-b30b31a59e1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:36:59.461450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89254-d349-423b-82c8-b30b31a59e1f service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:36:59.461690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89254-d349-423b-82c8-b30b31a59e1f service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:36:59.461946 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89254-d349-423b-82c8-b30b31a59e1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:36:59.464405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7ee89254-d349-423b-82c8-b30b31a59e1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:36:59.477780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee89254-d349-423b-82c8-b30b31a59e1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:36:59.479381 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee89254-d349-423b-82c8-b30b31a59e1f service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:36:59.490449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1266/2530] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:36:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:37:09.485742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=32 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:37:41.808366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452ff77-d59c-4ba2-a77c-a41a3ef1f228 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:37:41.808953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452ff77-d59c-4ba2-a77c-a41a3ef1f228 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:37:41.808953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452ff77-d59c-4ba2-a77c-a41a3ef1f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:37:41.827615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c452ff77-d59c-4ba2-a77c-a41a3ef1f228 None None] MFA Rules not processed for user `5b5a9f5cdfa6494d97617d68880d5552`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:37:41.829246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c452ff77-d59c-4ba2-a77c-a41a3ef1f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:37:41.892630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1265/2531] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:37:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:37:51.794253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9b212-1d75-4ee0-b807-60a9ab30bf87 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:37:51.795032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9b212-1d75-4ee0-b807-60a9ab30bf87 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:37:51.795032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9b212-1d75-4ee0-b807-60a9ab30bf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:37:51.817864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fad9b212-1d75-4ee0-b807-60a9ab30bf87 None None] MFA Rules not processed for user `cf94c76ba04b403b91a7ff77a2f476e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:37:51.819063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fad9b212-1d75-4ee0-b807-60a9ab30bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:37:51.877144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1267/2532] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:37:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:37:51.882076 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=25 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:01.870106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=25 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:22.668405 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452ff77-d59c-4ba2-a77c-a41a3ef1f228 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:22.669937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c452ff77-d59c-4ba2-a77c-a41a3ef1f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:22.682977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452ff77-d59c-4ba2-a77c-a41a3ef1f228 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:22.687029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e8f5a-0d7f-4dcb-93b8-e82a69e393bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:22.687712 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e8f5a-0d7f-4dcb-93b8-e82a69e393bd service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:22.687998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e8f5a-0d7f-4dcb-93b8-e82a69e393bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:22.688305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e8f5a-0d7f-4dcb-93b8-e82a69e393bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:22.690219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ed0e8f5a-0d7f-4dcb-93b8-e82a69e393bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:22.703295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e8f5a-0d7f-4dcb-93b8-e82a69e393bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:22.704793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e8f5a-0d7f-4dcb-93b8-e82a69e393bd service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:22.715063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1266/2533] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:25.698907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9b212-1d75-4ee0-b807-60a9ab30bf87 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:25.700552 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fad9b212-1d75-4ee0-b807-60a9ab30bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:25.714445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9b212-1d75-4ee0-b807-60a9ab30bf87 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:25.719068 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:25.719948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:25.720264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:25.720538 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] PATH_INFO: `/v3/users/bbb6c8f984d645dda88e2744f62a5213` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:25.721742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb6c8f984d645dda88e2744f62a5213)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:25.723685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:25.777437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb6c8f984d645dda88e2744f62a5213'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:25.778080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb6c8f984d645dda88e2744f62a5213'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:25.790206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb6c8f984d645dda88e2744f62a5213'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:25.790898 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb6c8f984d645dda88e2744f62a5213'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:25.797753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45790e56-5079-4456-b520-37e983dacedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb6c8f984d645dda88e2744f62a5213'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:25.812129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1268/2534] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:38:25 2022] DELETE /identity/v3/users/bbb6c8f984d645dda88e2744f62a5213 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:25.989820 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e8f5a-0d7f-4dcb-93b8-e82a69e393bd service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:26.001409 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e8f5a-0d7f-4dcb-93b8-e82a69e393bd service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:26.072100 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:26.073970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.074430 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.074977 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] PATH_INFO: `/v3/projects/4a74defc69084b06b8d6300d1ce15bc5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.076323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a74defc69084b06b8d6300d1ce15bc5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:26.078307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:26.128604 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a74defc69084b06b8d6300d1ce15bc5', 'request_id': 'req-f948dd6e-4523-480b-b252-41958126ec2e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:26.133814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a74defc69084b06b8d6300d1ce15bc5', 'request_id': 'req-f948dd6e-4523-480b-b252-41958126ec2e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:26.140354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a74defc69084b06b8d6300d1ce15bc5', 'request_id': 'req-f948dd6e-4523-480b-b252-41958126ec2e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:26.154002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] The token cache is being invalidate because project 4a74defc69084b06b8d6300d1ce15bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:38:26.154283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:26.154888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f948dd6e-4523-480b-b252-41958126ec2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:26.156562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1267/2535] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:38:25 2022] DELETE /identity/v3/projects/4a74defc69084b06b8d6300d1ce15bc5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:26.161918 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3451-d84f-47ee-bab7-bfaa79dd9fcf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.162240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3451-d84f-47ee-bab7-bfaa79dd9fcf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.162525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3451-d84f-47ee-bab7-bfaa79dd9fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.182975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-92bc3451-d84f-47ee-bab7-bfaa79dd9fcf None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:26.184370 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-92bc3451-d84f-47ee-bab7-bfaa79dd9fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:26.246628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1269/2536] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:26.256615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e62f2-e6c5-4f3d-b7b1-04127f00c421 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.256970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e62f2-e6c5-4f3d-b7b1-04127f00c421 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.257284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e62f2-e6c5-4f3d-b7b1-04127f00c421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.283266 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9c9e62f2-e6c5-4f3d-b7b1-04127f00c421 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:26.284527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9c9e62f2-e6c5-4f3d-b7b1-04127f00c421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:26.294600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1268/2537] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:26.299018 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc3451-d84f-47ee-bab7-bfaa79dd9fcf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:26.309106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc3451-d84f-47ee-bab7-bfaa79dd9fcf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:26.314112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c192e5-b005-44c9-a5ed-ae461658de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:26.314779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c192e5-b005-44c9-a5ed-ae461658de5b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.315058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c192e5-b005-44c9-a5ed-ae461658de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.315327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c192e5-b005-44c9-a5ed-ae461658de5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.316062 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c192e5-b005-44c9-a5ed-ae461658de5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:38:26.316401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c192e5-b005-44c9-a5ed-ae461658de5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:26.318021 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c192e5-b005-44c9-a5ed-ae461658de5b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:26.330343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1270/2538] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:38:26.335023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e62f2-e6c5-4f3d-b7b1-04127f00c421 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:26.344818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e62f2-e6c5-4f3d-b7b1-04127f00c421 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:26.350885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef154dd9-db49-4a90-8167-62839c78fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:26.351538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef154dd9-db49-4a90-8167-62839c78fda4 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.351824 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef154dd9-db49-4a90-8167-62839c78fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.352101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef154dd9-db49-4a90-8167-62839c78fda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.353039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef154dd9-db49-4a90-8167-62839c78fda4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:26.355174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef154dd9-db49-4a90-8167-62839c78fda4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:26.384520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1269/2539] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:38:26 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:26.388936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c192e5-b005-44c9-a5ed-ae461658de5b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:26.399515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c192e5-b005-44c9-a5ed-ae461658de5b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:26.455623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a74c3f-9551-4e82-beca-a09c4ffda31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:26.456316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74c3f-9551-4e82-beca-a09c4ffda31f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.456600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74c3f-9551-4e82-beca-a09c4ffda31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.456877 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74c3f-9551-4e82-beca-a09c4ffda31f admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.457576 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a74c3f-9551-4e82-beca-a09c4ffda31f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:26.459510 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a74c3f-9551-4e82-beca-a09c4ffda31f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:26.466596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:26.485844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1271/2540] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:38:26 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:38:26.490239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef154dd9-db49-4a90-8167-62839c78fda4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:26.500517 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef154dd9-db49-4a90-8167-62839c78fda4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:26.505085 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e76a7b-91ac-4645-9921-2361f4c68c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:26.505743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e76a7b-91ac-4645-9921-2361f4c68c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.506034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e76a7b-91ac-4645-9921-2361f4c68c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.506315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e76a7b-91ac-4645-9921-2361f4c68c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.507049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e76a7b-91ac-4645-9921-2361f4c68c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:26.508701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e76a7b-91ac-4645-9921-2361f4c68c52 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:26.519062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1270/2541] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:26.522965 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a74c3f-9551-4e82-beca-a09c4ffda31f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:26.533776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a74c3f-9551-4e82-beca-a09c4ffda31f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:26.539210 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef15a3-b452-4c00-8241-746faf686571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:26.539867 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef15a3-b452-4c00-8241-746faf686571 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.540197 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef15a3-b452-4c00-8241-746faf686571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.540475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef15a3-b452-4c00-8241-746faf686571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.541537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef15a3-b452-4c00-8241-746faf686571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:26.543137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef15a3-b452-4c00-8241-746faf686571 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:26.553396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1272/2542] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:26.557941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e76a7b-91ac-4645-9921-2361f4c68c52 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:26.568669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e76a7b-91ac-4645-9921-2361f4c68c52 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:26.574726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f05fa-0f54-40a3-8ba2-7f8ffd860acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:26.575639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f05fa-0f54-40a3-8ba2-7f8ffd860acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.575915 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f05fa-0f54-40a3-8ba2-7f8ffd860acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.576218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f05fa-0f54-40a3-8ba2-7f8ffd860acf admin admin] PATH_INFO: `/v3/projects/b4861fbe2a894b1096d96d64b8f72621/users/0a096d6713bf4caeb50d9f6298d94811/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.594752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f05fa-0f54-40a3-8ba2-7f8ffd860acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4861fbe2a894b1096d96d64b8f72621, user_id=0a096d6713bf4caeb50d9f6298d94811, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:26.598631 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f05fa-0f54-40a3-8ba2-7f8ffd860acf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:26.620061 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1271/2543] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:38:26 2022] PUT /identity/v3/projects/b4861fbe2a894b1096d96d64b8f72621/users/0a096d6713bf4caeb50d9f6298d94811/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:26.630359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2109a7-6d86-469e-8e36-2329432481a7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.630644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2109a7-6d86-469e-8e36-2329432481a7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.630947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2109a7-6d86-469e-8e36-2329432481a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.658771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1a2109a7-6d86-469e-8e36-2329432481a7 None None] MFA Rules not processed for user `0a096d6713bf4caeb50d9f6298d94811`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:26.659974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a2109a7-6d86-469e-8e36-2329432481a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:26.727874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1273/2544] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:38:26.732309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f05fa-0f54-40a3-8ba2-7f8ffd860acf admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:26.748049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:26.802019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f05fa-0f54-40a3-8ba2-7f8ffd860acf admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:26.807242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e944aa-a233-45b3-b72f-eab5e2dce382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:26.807925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e944aa-a233-45b3-b72f-eab5e2dce382 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.808245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e944aa-a233-45b3-b72f-eab5e2dce382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.808551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e944aa-a233-45b3-b72f-eab5e2dce382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.809261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e944aa-a233-45b3-b72f-eab5e2dce382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:26.811218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e944aa-a233-45b3-b72f-eab5e2dce382 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:26.842693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1272/2545] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:38:26 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:26.846262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2109a7-6d86-469e-8e36-2329432481a7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:26.863408 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2109a7-6d86-469e-8e36-2329432481a7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:26.927117 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e660c1f-7cbb-4e36-935f-c38c3139248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:26.927798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e660c1f-7cbb-4e36-935f-c38c3139248f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.928104 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e660c1f-7cbb-4e36-935f-c38c3139248f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.928378 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e660c1f-7cbb-4e36-935f-c38c3139248f admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.929078 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e660c1f-7cbb-4e36-935f-c38c3139248f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:26.931017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e660c1f-7cbb-4e36-935f-c38c3139248f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:26.955038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1274/2546] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:38:26 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:26.959147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e944aa-a233-45b3-b72f-eab5e2dce382 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:26.970578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e944aa-a233-45b3-b72f-eab5e2dce382 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:26.975668 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715a224-beae-4741-bec2-2c8bbba3b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:26.976366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715a224-beae-4741-bec2-2c8bbba3b059 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:26.976669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715a224-beae-4741-bec2-2c8bbba3b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:26.976945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715a224-beae-4741-bec2-2c8bbba3b059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:26.977666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715a224-beae-4741-bec2-2c8bbba3b059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:26.979516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715a224-beae-4741-bec2-2c8bbba3b059 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:26.990522 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1273/2547] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:26.994989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e660c1f-7cbb-4e36-935f-c38c3139248f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:27.005554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e660c1f-7cbb-4e36-935f-c38c3139248f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:27.011351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319385a-4cd2-4dc3-af0f-4164ce73a9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:27.012284 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319385a-4cd2-4dc3-af0f-4164ce73a9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:27.012574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319385a-4cd2-4dc3-af0f-4164ce73a9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:27.012855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319385a-4cd2-4dc3-af0f-4164ce73a9a4 admin admin] PATH_INFO: `/v3/projects/8963fc5846824564ae9ae9b446f593ba/users/1a73c06d96af4725a02a6204c9926815/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:27.028044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319385a-4cd2-4dc3-af0f-4164ce73a9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8963fc5846824564ae9ae9b446f593ba, user_id=1a73c06d96af4725a02a6204c9926815, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:27.030752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319385a-4cd2-4dc3-af0f-4164ce73a9a4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:27.047387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1275/2548] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:38:26 2022] PUT /identity/v3/projects/8963fc5846824564ae9ae9b446f593ba/users/1a73c06d96af4725a02a6204c9926815/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:27.052638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715a224-beae-4741-bec2-2c8bbba3b059 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:27.063156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715a224-beae-4741-bec2-2c8bbba3b059 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:27.126428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a40643-194e-40ba-92f7-512f7d8c050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:27.127103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40643-194e-40ba-92f7-512f7d8c050f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:27.127384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40643-194e-40ba-92f7-512f7d8c050f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:27.127743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40643-194e-40ba-92f7-512f7d8c050f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:27.128515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a40643-194e-40ba-92f7-512f7d8c050f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:27.130113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a40643-194e-40ba-92f7-512f7d8c050f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:27.140873 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1274/2549] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:38:27.145086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319385a-4cd2-4dc3-af0f-4164ce73a9a4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:27.155778 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319385a-4cd2-4dc3-af0f-4164ce73a9a4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:27.160868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb0f4d-9ccd-4456-8ea7-88219fa7f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:27.161751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb0f4d-9ccd-4456-8ea7-88219fa7f9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:27.162028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb0f4d-9ccd-4456-8ea7-88219fa7f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:27.162455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb0f4d-9ccd-4456-8ea7-88219fa7f9bd admin admin] PATH_INFO: `/v3/projects/8963fc5846824564ae9ae9b446f593ba/users/1a73c06d96af4725a02a6204c9926815/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:27.164419 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb0f4d-9ccd-4456-8ea7-88219fa7f9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8963fc5846824564ae9ae9b446f593ba, user_id=1a73c06d96af4725a02a6204c9926815, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:27.167521 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb0f4d-9ccd-4456-8ea7-88219fa7f9bd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:27.178864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1276/2550] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:38:27 2022] PUT /identity/v3/projects/8963fc5846824564ae9ae9b446f593ba/users/1a73c06d96af4725a02a6204c9926815/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:38:27.190320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef6119-0e90-4c25-bba8-af2ef741f860 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:27.190608 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef6119-0e90-4c25-bba8-af2ef741f860 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:27.190885 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef6119-0e90-4c25-bba8-af2ef741f860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:27.220094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-88ef6119-0e90-4c25-bba8-af2ef741f860 None None] MFA Rules not processed for user `1a73c06d96af4725a02a6204c9926815`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:27.221326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-88ef6119-0e90-4c25-bba8-af2ef741f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:27.308857 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1275/2551] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:27.323590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb0f4d-9ccd-4456-8ea7-88219fa7f9bd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:27.325289 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-79fb0f4d-9ccd-4456-8ea7-88219fa7f9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:27.350443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:27.408380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb0f4d-9ccd-4456-8ea7-88219fa7f9bd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:27.412273 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fb222-5d02-4554-a6ec-450c9b1ab4d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:27.412886 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fb222-5d02-4554-a6ec-450c9b1ab4d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:27.413164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fb222-5d02-4554-a6ec-450c9b1ab4d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:27.413434 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fb222-5d02-4554-a6ec-450c9b1ab4d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:27.424112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fb222-5d02-4554-a6ec-450c9b1ab4d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:27.425560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fb222-5d02-4554-a6ec-450c9b1ab4d0 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:27.439652 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1277/2552] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:27.510943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef6119-0e90-4c25-bba8-af2ef741f860 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:27.521294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:27.579659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef6119-0e90-4c25-bba8-af2ef741f860 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:27.585153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:27.586139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:27.586425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:27.586696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] PATH_INFO: `/v3/users/0a096d6713bf4caeb50d9f6298d94811` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:27.588564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a096d6713bf4caeb50d9f6298d94811)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:27.590527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:27.643417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a096d6713bf4caeb50d9f6298d94811'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:27.655834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a096d6713bf4caeb50d9f6298d94811'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:27.664808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a096d6713bf4caeb50d9f6298d94811'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:27.673302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a096d6713bf4caeb50d9f6298d94811'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:27.674118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a096d6713bf4caeb50d9f6298d94811'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:27.680219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1276/2553] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:38:27 2022] DELETE /identity/v3/users/0a096d6713bf4caeb50d9f6298d94811 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:27.684948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4251-d4ca-42b5-9b2b-cccc6c06eccd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:27.685231 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4251-d4ca-42b5-9b2b-cccc6c06eccd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:27.685508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d4251-d4ca-42b5-9b2b-cccc6c06eccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:27.703691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-413d4251-d4ca-42b5-9b2b-cccc6c06eccd None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:27.704938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-413d4251-d4ca-42b5-9b2b-cccc6c06eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:27.773999 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1278/2554] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:27.784770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:27.786436 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:27.845386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2235-5a6a-4e68-8f83-bdea300cd2e9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:27.849525 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c0257-cdd7-41ee-aea9-9f7ec0bb6614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:27.850169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c0257-cdd7-41ee-aea9-9f7ec0bb6614 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:27.850445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c0257-cdd7-41ee-aea9-9f7ec0bb6614 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:27.850723 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c0257-cdd7-41ee-aea9-9f7ec0bb6614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:27.864838 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c0257-cdd7-41ee-aea9-9f7ec0bb6614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:27.867198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c0257-cdd7-41ee-aea9-9f7ec0bb6614 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:27.878096 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1277/2555] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:28.174882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4251-d4ca-42b5-9b2b-cccc6c06eccd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:28.176403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-413d4251-d4ca-42b5-9b2b-cccc6c06eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:28.191130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d4251-d4ca-42b5-9b2b-cccc6c06eccd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:28.196174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:28.197084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:28.197445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:28.198315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] PATH_INFO: `/v3/projects/b4861fbe2a894b1096d96d64b8f72621` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:28.199525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4861fbe2a894b1096d96d64b8f72621)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:28.201501 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:28.253931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4861fbe2a894b1096d96d64b8f72621', 'request_id': 'req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:28.263532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4861fbe2a894b1096d96d64b8f72621', 'request_id': 'req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:28.270084 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4861fbe2a894b1096d96d64b8f72621', 'request_id': 'req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:28.280696 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] The token cache is being invalidate because project b4861fbe2a894b1096d96d64b8f72621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:38:28.280978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:28.281596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:28.283602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1279/2556] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:38:28 2022] DELETE /identity/v3/projects/b4861fbe2a894b1096d96d64b8f72621 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:28.287759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c0257-cdd7-41ee-aea9-9f7ec0bb6614 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:28.298328 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c0257-cdd7-41ee-aea9-9f7ec0bb6614 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:28.337374 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:28.367974 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:28.368900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:28.369182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:28.369580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] PATH_INFO: `/v3/users/1a73c06d96af4725a02a6204c9926815` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:28.370833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a73c06d96af4725a02a6204c9926815)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:28.372839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:28.426394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a73c06d96af4725a02a6204c9926815'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:28.439283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a73c06d96af4725a02a6204c9926815'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:28.448700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a73c06d96af4725a02a6204c9926815'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:28.456054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a73c06d96af4725a02a6204c9926815'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:28.456709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a3810ddd-9b29-4b67-846e-afd85e58ae55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a73c06d96af4725a02a6204c9926815'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:28.462925 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1278/2557] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:38:28 2022] DELETE /identity/v3/users/1a73c06d96af4725a02a6204c9926815 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:28.984063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:28.985605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:28.998880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38740261-bc0e-41bf-8d9d-f9a5428dc0a7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:29.024953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:29.057936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:29.058807 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.059083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.059356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] PATH_INFO: `/v3/projects/8963fc5846824564ae9ae9b446f593ba` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.060553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8963fc5846824564ae9ae9b446f593ba)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:29.062480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:29.114673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8963fc5846824564ae9ae9b446f593ba', 'request_id': 'req-42dcc13a-9107-47b2-94fa-683305e59c3e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:29.123814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8963fc5846824564ae9ae9b446f593ba', 'request_id': 'req-42dcc13a-9107-47b2-94fa-683305e59c3e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:29.130106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8963fc5846824564ae9ae9b446f593ba', 'request_id': 'req-42dcc13a-9107-47b2-94fa-683305e59c3e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:29.140858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] The token cache is being invalidate because project 8963fc5846824564ae9ae9b446f593ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:38:29.141142 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:29.141801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-42dcc13a-9107-47b2-94fa-683305e59c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:29.143333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1280/2558] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:38:28 2022] DELETE /identity/v3/projects/8963fc5846824564ae9ae9b446f593ba => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:29.148508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211aefd-2046-4bd0-a8cb-1eac641be554 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.148799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211aefd-2046-4bd0-a8cb-1eac641be554 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.149081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211aefd-2046-4bd0-a8cb-1eac641be554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.168987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5211aefd-2046-4bd0-a8cb-1eac641be554 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:29.170417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5211aefd-2046-4bd0-a8cb-1eac641be554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:29.231463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1279/2559] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:29.240845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638c949-953c-4d69-b40d-37c1175eca82 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.241137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638c949-953c-4d69-b40d-37c1175eca82 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.241417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638c949-953c-4d69-b40d-37c1175eca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.260980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d638c949-953c-4d69-b40d-37c1175eca82 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:29.262232 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d638c949-953c-4d69-b40d-37c1175eca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:29.271633 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1281/2560] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:29.276416 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211aefd-2046-4bd0-a8cb-1eac641be554 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:29.289995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211aefd-2046-4bd0-a8cb-1eac641be554 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:29.296460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e36c3d-be79-4795-9db6-6520af6b1d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:29.297148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36c3d-be79-4795-9db6-6520af6b1d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.297423 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36c3d-be79-4795-9db6-6520af6b1d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.297703 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36c3d-be79-4795-9db6-6520af6b1d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.298441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e36c3d-be79-4795-9db6-6520af6b1d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:38:29.298753 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e36c3d-be79-4795-9db6-6520af6b1d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:29.300471 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e36c3d-be79-4795-9db6-6520af6b1d8d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:29.313147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1280/2561] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:38:29.317681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638c949-953c-4d69-b40d-37c1175eca82 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:29.327467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638c949-953c-4d69-b40d-37c1175eca82 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:29.332968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0d616-d1d3-40fb-8274-7f28294c23f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:29.333624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0d616-d1d3-40fb-8274-7f28294c23f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.333909 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0d616-d1d3-40fb-8274-7f28294c23f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.334182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0d616-d1d3-40fb-8274-7f28294c23f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.334879 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0d616-d1d3-40fb-8274-7f28294c23f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:29.336840 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0d616-d1d3-40fb-8274-7f28294c23f5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:29.367998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1282/2562] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:38:29 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:29.369248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e36c3d-be79-4795-9db6-6520af6b1d8d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:29.379261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e36c3d-be79-4795-9db6-6520af6b1d8d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:29.412963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:29.445656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681489b-a786-4834-9d7c-e6c9f450954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:29.446333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681489b-a786-4834-9d7c-e6c9f450954c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.446612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681489b-a786-4834-9d7c-e6c9f450954c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.446882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681489b-a786-4834-9d7c-e6c9f450954c admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.447575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681489b-a786-4834-9d7c-e6c9f450954c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:29.449532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681489b-a786-4834-9d7c-e6c9f450954c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:29.473566 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1281/2563] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:38:29 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:29.480836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0d616-d1d3-40fb-8274-7f28294c23f5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:29.496893 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0d616-d1d3-40fb-8274-7f28294c23f5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:29.502236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dfae2-af24-4f1a-bb91-20828b037edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:29.502913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dfae2-af24-4f1a-bb91-20828b037edc admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.503445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dfae2-af24-4f1a-bb91-20828b037edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.503710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dfae2-af24-4f1a-bb91-20828b037edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.504499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dfae2-af24-4f1a-bb91-20828b037edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:29.506157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dfae2-af24-4f1a-bb91-20828b037edc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:29.517789 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1283/2564] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:29.522217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681489b-a786-4834-9d7c-e6c9f450954c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:29.534595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681489b-a786-4834-9d7c-e6c9f450954c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:29.540175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e81666-f720-4ba0-be55-6c0a5a320c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:29.540845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e81666-f720-4ba0-be55-6c0a5a320c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.541145 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e81666-f720-4ba0-be55-6c0a5a320c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.541427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e81666-f720-4ba0-be55-6c0a5a320c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.542318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e81666-f720-4ba0-be55-6c0a5a320c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:29.543950 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e81666-f720-4ba0-be55-6c0a5a320c05 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:29.554843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1282/2565] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:29.558885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dfae2-af24-4f1a-bb91-20828b037edc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:29.568885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dfae2-af24-4f1a-bb91-20828b037edc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:29.573714 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dc216-00b8-4f91-8204-8867411a8b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:29.574602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dc216-00b8-4f91-8204-8867411a8b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.574881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dc216-00b8-4f91-8204-8867411a8b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.575155 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dc216-00b8-4f91-8204-8867411a8b14 admin admin] PATH_INFO: `/v3/projects/5532767d97504925b82f1819095c5d88/users/79196b75b48944b4b3fb655b404e1b62/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.590698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dc216-00b8-4f91-8204-8867411a8b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5532767d97504925b82f1819095c5d88, user_id=79196b75b48944b4b3fb655b404e1b62, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:29.593459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dc216-00b8-4f91-8204-8867411a8b14 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:29.608873 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1284/2566] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:38:29 2022] PUT /identity/v3/projects/5532767d97504925b82f1819095c5d88/users/79196b75b48944b4b3fb655b404e1b62/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:29.614675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d299c0d-2e8a-475f-99b5-2c52597ce2dd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.614966 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d299c0d-2e8a-475f-99b5-2c52597ce2dd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.615435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d299c0d-2e8a-475f-99b5-2c52597ce2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.635099 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4d299c0d-2e8a-475f-99b5-2c52597ce2dd None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:29.636817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4d299c0d-2e8a-475f-99b5-2c52597ce2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:29.700290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1283/2567] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:29.710131 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dc216-00b8-4f91-8204-8867411a8b14 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:29.712175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-691dc216-00b8-4f91-8204-8867411a8b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:29.772568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dc216-00b8-4f91-8204-8867411a8b14 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:29.776553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7810ba-8746-4711-886e-14c917571a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:29.777202 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7810ba-8746-4711-886e-14c917571a93 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:29.777488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7810ba-8746-4711-886e-14c917571a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:29.777758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7810ba-8746-4711-886e-14c917571a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:29.785306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:29.787833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7810ba-8746-4711-886e-14c917571a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:29.789478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7810ba-8746-4711-886e-14c917571a93 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:29.801365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1285/2568] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:38:30.363585 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd812d-ec83-49d8-ac28-16813895979e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:30.364138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd812d-ec83-49d8-ac28-16813895979e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:30.364259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd812d-ec83-49d8-ac28-16813895979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:30.383821 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d0fd812d-ec83-49d8-ac28-16813895979e None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:30.385455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d0fd812d-ec83-49d8-ac28-16813895979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:30.459900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1284/2569] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:38:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:30.473398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2988da-ed50-45b6-89e2-fb4108c8be9b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:30.473920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2988da-ed50-45b6-89e2-fb4108c8be9b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:30.474115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2988da-ed50-45b6-89e2-fb4108c8be9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:30.507513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fe2988da-ed50-45b6-89e2-fb4108c8be9b None None] MFA Rules not processed for user `79196b75b48944b4b3fb655b404e1b62`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:30.509514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fe2988da-ed50-45b6-89e2-fb4108c8be9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:30.518241 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd812d-ec83-49d8-ac28-16813895979e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:30.520478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d0fd812d-ec83-49d8-ac28-16813895979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:30.595502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1286/2570] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:38:30.596524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2988da-ed50-45b6-89e2-fb4108c8be9b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:30.608424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2988da-ed50-45b6-89e2-fb4108c8be9b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:30.615559 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884ba0-a8bf-4118-b1af-4354d06db38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:30.616455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884ba0-a8bf-4118-b1af-4354d06db38e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:30.617037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884ba0-a8bf-4118-b1af-4354d06db38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:30.617555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884ba0-a8bf-4118-b1af-4354d06db38e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:30.618454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c884ba0-a8bf-4118-b1af-4354d06db38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:30.620795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c884ba0-a8bf-4118-b1af-4354d06db38e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:30.630077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:30.635972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd812d-ec83-49d8-ac28-16813895979e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:30.643144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ac749-564e-4ef5-8c88-4c559957bd2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:30.643963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ac749-564e-4ef5-8c88-4c559957bd2d service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:30.644316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ac749-564e-4ef5-8c88-4c559957bd2d service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:30.644551 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ac749-564e-4ef5-8c88-4c559957bd2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:30.654562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ac749-564e-4ef5-8c88-4c559957bd2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:30.656247 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ac749-564e-4ef5-8c88-4c559957bd2d service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:30.656662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1287/2571] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:38:30 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:38:30.660991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884ba0-a8bf-4118-b1af-4354d06db38e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:30.665733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1285/2572] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:38:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 18:38:30.764137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884ba0-a8bf-4118-b1af-4354d06db38e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:30.768742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fda37d-cfe9-47cb-bbf8-97f713acfcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:30.769423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fda37d-cfe9-47cb-bbf8-97f713acfcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:30.769710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fda37d-cfe9-47cb-bbf8-97f713acfcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:30.769984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fda37d-cfe9-47cb-bbf8-97f713acfcf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:30.771385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fda37d-cfe9-47cb-bbf8-97f713acfcf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:30.773384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fda37d-cfe9-47cb-bbf8-97f713acfcf4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:30.802358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1288/2573] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:38:30 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:30.806354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ac749-564e-4ef5-8c88-4c559957bd2d service swift] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:30.824479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ac749-564e-4ef5-8c88-4c559957bd2d service swift] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:30.830140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825380c-e282-4012-a63d-f42ec2b55680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:30.830952 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825380c-e282-4012-a63d-f42ec2b55680 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:30.831265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825380c-e282-4012-a63d-f42ec2b55680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:30.831608 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825380c-e282-4012-a63d-f42ec2b55680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:30.833049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825380c-e282-4012-a63d-f42ec2b55680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:30.834922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825380c-e282-4012-a63d-f42ec2b55680 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:30.852418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1286/2574] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:30.852957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fda37d-cfe9-47cb-bbf8-97f713acfcf4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:30.880670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fda37d-cfe9-47cb-bbf8-97f713acfcf4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:30.886481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfcc5d-552a-4e37-aaa8-db91a0664e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:30.887570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfcc5d-552a-4e37-aaa8-db91a0664e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:30.887885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfcc5d-552a-4e37-aaa8-db91a0664e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:30.888239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfcc5d-552a-4e37-aaa8-db91a0664e54 admin admin] PATH_INFO: `/v3/projects/dc8403ed75954f8e91f7ff9bbfb85399/users/bc07d5878bb040f08a553cb7a051b948/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:30.908574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfcc5d-552a-4e37-aaa8-db91a0664e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8403ed75954f8e91f7ff9bbfb85399, user_id=bc07d5878bb040f08a553cb7a051b948, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:30.911833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfcc5d-552a-4e37-aaa8-db91a0664e54 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:30.929843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1289/2575] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:38:30 2022] PUT /identity/v3/projects/dc8403ed75954f8e91f7ff9bbfb85399/users/bc07d5878bb040f08a553cb7a051b948/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:30.934240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825380c-e282-4012-a63d-f42ec2b55680 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:30.944931 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825380c-e282-4012-a63d-f42ec2b55680 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:31.018717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb1d31-8905-4446-aa00-33c91d360d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:31.019455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb1d31-8905-4446-aa00-33c91d360d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:31.020087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb1d31-8905-4446-aa00-33c91d360d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:31.020467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb1d31-8905-4446-aa00-33c91d360d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:31.021305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb1d31-8905-4446-aa00-33c91d360d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:31.023381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb1d31-8905-4446-aa00-33c91d360d70 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:31.036041 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1287/2576] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:31.040193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfcc5d-552a-4e37-aaa8-db91a0664e54 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:31.052357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfcc5d-552a-4e37-aaa8-db91a0664e54 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:31.057363 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b1225-199a-45d9-918a-66b5075afcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:31.059040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b1225-199a-45d9-918a-66b5075afcd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:31.059326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b1225-199a-45d9-918a-66b5075afcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:31.059607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b1225-199a-45d9-918a-66b5075afcd0 admin admin] PATH_INFO: `/v3/projects/dc8403ed75954f8e91f7ff9bbfb85399/users/bc07d5878bb040f08a553cb7a051b948/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:31.061681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b1225-199a-45d9-918a-66b5075afcd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8403ed75954f8e91f7ff9bbfb85399, user_id=bc07d5878bb040f08a553cb7a051b948, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:31.064534 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b1225-199a-45d9-918a-66b5075afcd0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:31.077172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1290/2577] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:38:31 2022] PUT /identity/v3/projects/dc8403ed75954f8e91f7ff9bbfb85399/users/bc07d5878bb040f08a553cb7a051b948/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:38:31.847035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5c17-34e7-4e4f-b210-c4d36cd1f967 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:31.847548 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5c17-34e7-4e4f-b210-c4d36cd1f967 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:31.847651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5c17-34e7-4e4f-b210-c4d36cd1f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:31.887058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ebbe5c17-34e7-4e4f-b210-c4d36cd1f967 None None] MFA Rules not processed for user `bc07d5878bb040f08a553cb7a051b948`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:31.888766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ebbe5c17-34e7-4e4f-b210-c4d36cd1f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:32.001458 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1288/2578] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:32.010292 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b1225-199a-45d9-918a-66b5075afcd0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:32.013454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0c5b1225-199a-45d9-918a-66b5075afcd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:32.048537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:32.118314 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b1225-199a-45d9-918a-66b5075afcd0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:32.123256 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0915ee-27af-42ce-8ac0-e1f2ed834393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:32.124191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0915ee-27af-42ce-8ac0-e1f2ed834393 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:32.124588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0915ee-27af-42ce-8ac0-e1f2ed834393 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:32.124969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0915ee-27af-42ce-8ac0-e1f2ed834393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:32.213437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0915ee-27af-42ce-8ac0-e1f2ed834393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:32.215048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0915ee-27af-42ce-8ac0-e1f2ed834393 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:32.225312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1291/2579] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:33.656297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe5c17-34e7-4e4f-b210-c4d36cd1f967 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:33.658657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ebbe5c17-34e7-4e4f-b210-c4d36cd1f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:33.694874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe5c17-34e7-4e4f-b210-c4d36cd1f967 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:33.699500 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0e904-52f5-40bf-9e7d-433b7e60e2c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:33.700196 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e904-52f5-40bf-9e7d-433b7e60e2c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:33.700478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e904-52f5-40bf-9e7d-433b7e60e2c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:33.700755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e904-52f5-40bf-9e7d-433b7e60e2c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:33.711277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0e904-52f5-40bf-9e7d-433b7e60e2c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:33.712799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0e904-52f5-40bf-9e7d-433b7e60e2c6 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:33.724445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1289/2580] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:42.220786 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=41 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:43.720393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=78 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:44.993240 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c9bda-ba59-4677-b5ec-00ba8b132b1a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:44.993804 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c9bda-ba59-4677-b5ec-00ba8b132b1a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:44.994262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c9bda-ba59-4677-b5ec-00ba8b132b1a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:44.996235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1292/2581] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:38:45.003397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03494a-21bf-4ee0-892f-52b9fbb9e617 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:45.003954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03494a-21bf-4ee0-892f-52b9fbb9e617 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:45.003954 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03494a-21bf-4ee0-892f-52b9fbb9e617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:45.050858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9d03494a-21bf-4ee0-892f-52b9fbb9e617 None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:45.052036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9d03494a-21bf-4ee0-892f-52b9fbb9e617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:45.126527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1290/2582] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:45.140302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c9bda-ba59-4677-b5ec-00ba8b132b1a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:45.142080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f24c9bda-ba59-4677-b5ec-00ba8b132b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:45.206966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c9bda-ba59-4677-b5ec-00ba8b132b1a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:45.212249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7ad65-a473-4379-9cd1-2b5ccd0cf578 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4adc107bf542b8bb0502c7fbf94431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:45.213144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ad65-a473-4379-9cd1-2b5ccd0cf578 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:45.213511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ad65-a473-4379-9cd1-2b5ccd0cf578 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:45.213809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ad65-a473-4379-9cd1-2b5ccd0cf578 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:45.224675 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7ad65-a473-4379-9cd1-2b5ccd0cf578 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:45.226107 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7ad65-a473-4379-9cd1-2b5ccd0cf578 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:45.236758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1293/2583] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:38:45.310998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1f789-030a-42c1-b64d-a05921ae60a1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:45.311232 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1f789-030a-42c1-b64d-a05921ae60a1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:45.311511 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1f789-030a-42c1-b64d-a05921ae60a1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:45.313195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1291/2584] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:38:45.317934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89a959-43ee-4adf-8bcb-a04bb5176f58 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:45.318265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89a959-43ee-4adf-8bcb-a04bb5176f58 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:45.318560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89a959-43ee-4adf-8bcb-a04bb5176f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:45.339288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cd89a959-43ee-4adf-8bcb-a04bb5176f58 None None] MFA Rules not processed for user `37c4400204794a54957ccf28df938f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:45.341454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cd89a959-43ee-4adf-8bcb-a04bb5176f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:45.395935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1294/2585] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:45.409097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1f789-030a-42c1-b64d-a05921ae60a1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:45.411920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-65d1f789-030a-42c1-b64d-a05921ae60a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:45.427797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1f789-030a-42c1-b64d-a05921ae60a1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:45.431557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520c49-6a0b-4bb7-a2df-bfae39dd6cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:45.432219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520c49-6a0b-4bb7-a2df-bfae39dd6cba service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:45.432501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520c49-6a0b-4bb7-a2df-bfae39dd6cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:45.432771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520c49-6a0b-4bb7-a2df-bfae39dd6cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:45.439985 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1520c49-6a0b-4bb7-a2df-bfae39dd6cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:45.441454 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1520c49-6a0b-4bb7-a2df-bfae39dd6cba service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:45.449097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1292/2586] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:45.550224 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf0cc2-20b9-4a02-aae4-3fd2b650cd56 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:45.550540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf0cc2-20b9-4a02-aae4-3fd2b650cd56 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:45.550818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf0cc2-20b9-4a02-aae4-3fd2b650cd56 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:45.552276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1295/2587] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:38:45.558226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e0800-0f74-4b67-9792-78568ae10a4d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:45.558523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e0800-0f74-4b67-9792-78568ae10a4d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:45.559326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e0800-0f74-4b67-9792-78568ae10a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:45.579573 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-047e0800-0f74-4b67-9792-78568ae10a4d None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:45.580737 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-047e0800-0f74-4b67-9792-78568ae10a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:45.591464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1293/2588] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:45.605051 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf0cc2-20b9-4a02-aae4-3fd2b650cd56 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:45.623045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf0cc2-20b9-4a02-aae4-3fd2b650cd56 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:45.630271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cf69f-801c-4e93-bb9e-142da3bd4062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:45.631212 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf69f-801c-4e93-bb9e-142da3bd4062 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:45.631681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf69f-801c-4e93-bb9e-142da3bd4062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:45.632030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf69f-801c-4e93-bb9e-142da3bd4062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:45.645061 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cf69f-801c-4e93-bb9e-142da3bd4062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:45.646506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cf69f-801c-4e93-bb9e-142da3bd4062 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:45.657503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1296/2589] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:47.228108 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e0800-0f74-4b67-9792-78568ae10a4d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:47.298179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e0800-0f74-4b67-9792-78568ae10a4d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:47.304191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:47.305189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:47.305726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:47.306190 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] PATH_INFO: `/v3/users/79196b75b48944b4b3fb655b404e1b62` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:47.308276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79196b75b48944b4b3fb655b404e1b62)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:47.310603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:47.366886 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79196b75b48944b4b3fb655b404e1b62'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.381188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:47.383436 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79196b75b48944b4b3fb655b404e1b62'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.395172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79196b75b48944b4b3fb655b404e1b62'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.405851 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79196b75b48944b4b3fb655b404e1b62'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.406740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79196b75b48944b4b3fb655b404e1b62'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.416129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1294/2590] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:38:47 2022] DELETE /identity/v3/users/79196b75b48944b4b3fb655b404e1b62 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:47.676448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cf69f-801c-4e93-bb9e-142da3bd4062 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:47.707912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cf69f-801c-4e93-bb9e-142da3bd4062 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:47.767122 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:47.767992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:47.768376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:47.768649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] PATH_INFO: `/v3/projects/5532767d97504925b82f1819095c5d88` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:47.769850 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5532767d97504925b82f1819095c5d88)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:47.771772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:47.815119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:47.823457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5532767d97504925b82f1819095c5d88', 'request_id': 'req-a28872f6-ca96-42b1-9720-0ae6133a0277'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.831706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5532767d97504925b82f1819095c5d88', 'request_id': 'req-a28872f6-ca96-42b1-9720-0ae6133a0277'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.838761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5532767d97504925b82f1819095c5d88', 'request_id': 'req-a28872f6-ca96-42b1-9720-0ae6133a0277'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.849626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] The token cache is being invalidate because project 5532767d97504925b82f1819095c5d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:38:47.849930 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.850567 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a28872f6-ca96-42b1-9720-0ae6133a0277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.852147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1297/2591] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:38:47 2022] DELETE /identity/v3/projects/5532767d97504925b82f1819095c5d88 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:47.856536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:47.858128 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:47.870968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4654a-d3d1-4aa8-9b9d-f525c33e8a49 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:47.928285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:47.929194 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:47.929492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:47.929751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] PATH_INFO: `/v3/users/bc07d5878bb040f08a553cb7a051b948` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:47.930920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc07d5878bb040f08a553cb7a051b948)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:47.932877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:47.985044 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc07d5878bb040f08a553cb7a051b948'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:47.999255 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc07d5878bb040f08a553cb7a051b948'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:48.007830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc07d5878bb040f08a553cb7a051b948'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:48.014878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc07d5878bb040f08a553cb7a051b948'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:48.015501 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc07d5878bb040f08a553cb7a051b948'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:48.021332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1295/2592] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:38:47 2022] DELETE /identity/v3/users/bc07d5878bb040f08a553cb7a051b948 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:48.145065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e698379-c65e-4f74-800b-419880020c75 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:48.145353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e698379-c65e-4f74-800b-419880020c75 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:48.145628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e698379-c65e-4f74-800b-419880020c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:48.164544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4e698379-c65e-4f74-800b-419880020c75 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:48.165745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4e698379-c65e-4f74-800b-419880020c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:48.205644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:48.207308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:48.242488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1298/2593] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:38:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:48.255024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e698379-c65e-4f74-800b-419880020c75 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:48.256560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4e698379-c65e-4f74-800b-419880020c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:48.285512 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:48.289989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccfeb7-2dc8-47fd-bd50-bb0175a4ef18 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:48.300065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:48.305139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:48.305139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:48.305139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] PATH_INFO: `/v3/projects/dc8403ed75954f8e91f7ff9bbfb85399` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:48.306398 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8403ed75954f8e91f7ff9bbfb85399)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:48.308589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:48.330400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e698379-c65e-4f74-800b-419880020c75 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:48.335800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f368a5-a947-4705-be5f-43792a505d30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:48.336570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f368a5-a947-4705-be5f-43792a505d30 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:48.336846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f368a5-a947-4705-be5f-43792a505d30 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:48.337123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f368a5-a947-4705-be5f-43792a505d30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:48.345360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f368a5-a947-4705-be5f-43792a505d30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:48.346956 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f368a5-a947-4705-be5f-43792a505d30 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:48.354959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1299/2594] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:38:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 18:38:48.356837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8403ed75954f8e91f7ff9bbfb85399', 'request_id': 'req-102f086b-c193-450e-9977-731ac79967a1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:48.363034 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8403ed75954f8e91f7ff9bbfb85399', 'request_id': 'req-102f086b-c193-450e-9977-731ac79967a1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:48.369914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8403ed75954f8e91f7ff9bbfb85399', 'request_id': 'req-102f086b-c193-450e-9977-731ac79967a1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:48.384667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] The token cache is being invalidate because project dc8403ed75954f8e91f7ff9bbfb85399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:38:48.384958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:48.385576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-102f086b-c193-450e-9977-731ac79967a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:48.387664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1296/2595] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:38:48 2022] DELETE /identity/v3/projects/dc8403ed75954f8e91f7ff9bbfb85399 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:48.392554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7937-d2c5-4b88-b110-505bbed48af0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:48.392842 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7937-d2c5-4b88-b110-505bbed48af0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:48.393118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7937-d2c5-4b88-b110-505bbed48af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:48.419838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fcaa7937-d2c5-4b88-b110-505bbed48af0 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:48.421569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fcaa7937-d2c5-4b88-b110-505bbed48af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:48.523931 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1300/2596] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:48.531958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377668d-3367-41c6-8249-d0c800cdfd55 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:48.532358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377668d-3367-41c6-8249-d0c800cdfd55 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:48.532563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377668d-3367-41c6-8249-d0c800cdfd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:48.570368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e377668d-3367-41c6-8249-d0c800cdfd55 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:48.573290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e377668d-3367-41c6-8249-d0c800cdfd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:48.596600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1297/2597] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:48.598591 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7937-d2c5-4b88-b110-505bbed48af0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:48.607551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:48.613444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7937-d2c5-4b88-b110-505bbed48af0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:48.625314 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec20e1-39e3-4c49-bd8e-d54426eb8083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:48.626260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec20e1-39e3-4c49-bd8e-d54426eb8083 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:48.626726 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec20e1-39e3-4c49-bd8e-d54426eb8083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:48.628140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec20e1-39e3-4c49-bd8e-d54426eb8083 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:48.630279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec20e1-39e3-4c49-bd8e-d54426eb8083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:38:48.631322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec20e1-39e3-4c49-bd8e-d54426eb8083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:48.635101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec20e1-39e3-4c49-bd8e-d54426eb8083 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:48.696399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1301/2598] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:38:48.697277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377668d-3367-41c6-8249-d0c800cdfd55 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:48.726309 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377668d-3367-41c6-8249-d0c800cdfd55 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:48.731268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5af01d-917c-4efb-9fe5-f2e77cafda4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:48.732025 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5af01d-917c-4efb-9fe5-f2e77cafda4d admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:48.732329 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5af01d-917c-4efb-9fe5-f2e77cafda4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:48.732607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5af01d-917c-4efb-9fe5-f2e77cafda4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:48.733321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5af01d-917c-4efb-9fe5-f2e77cafda4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:48.747755 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5af01d-917c-4efb-9fe5-f2e77cafda4d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:48.784985 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1298/2599] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:38:48 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:48.789279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec20e1-39e3-4c49-bd8e-d54426eb8083 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:48.800957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec20e1-39e3-4c49-bd8e-d54426eb8083 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:48.898083 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48790e0f-4b3d-4d43-b8b8-836ccb3c7cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:48.898763 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48790e0f-4b3d-4d43-b8b8-836ccb3c7cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:48.899046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48790e0f-4b3d-4d43-b8b8-836ccb3c7cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:48.899322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48790e0f-4b3d-4d43-b8b8-836ccb3c7cdf admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:48.900070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48790e0f-4b3d-4d43-b8b8-836ccb3c7cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:48.902152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48790e0f-4b3d-4d43-b8b8-836ccb3c7cdf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:48.928802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1302/2600] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:38:48 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:48.932948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5af01d-917c-4efb-9fe5-f2e77cafda4d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:48.946119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5af01d-917c-4efb-9fe5-f2e77cafda4d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:48.951576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddcf61-b7be-44ec-98dd-bf9817cdde77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:48.952488 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddcf61-b7be-44ec-98dd-bf9817cdde77 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:48.952799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddcf61-b7be-44ec-98dd-bf9817cdde77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:48.953076 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddcf61-b7be-44ec-98dd-bf9817cdde77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:48.953851 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddcf61-b7be-44ec-98dd-bf9817cdde77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:48.955492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddcf61-b7be-44ec-98dd-bf9817cdde77 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:48.967875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1299/2601] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:48.972070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48790e0f-4b3d-4d43-b8b8-836ccb3c7cdf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:48.982525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48790e0f-4b3d-4d43-b8b8-836ccb3c7cdf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:48.987676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a127775-edd7-4d56-8830-46fd74de9ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:48.988395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127775-edd7-4d56-8830-46fd74de9ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:48.988674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127775-edd7-4d56-8830-46fd74de9ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:48.989008 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127775-edd7-4d56-8830-46fd74de9ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:48.989697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a127775-edd7-4d56-8830-46fd74de9ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:48.991375 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a127775-edd7-4d56-8830-46fd74de9ecd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:49.003802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1303/2602] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:49.008102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddcf61-b7be-44ec-98dd-bf9817cdde77 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:49.018923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddcf61-b7be-44ec-98dd-bf9817cdde77 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:49.023589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c9c02-b446-4a01-957e-f98a46498f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:49.024497 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c9c02-b446-4a01-957e-f98a46498f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:49.024783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c9c02-b446-4a01-957e-f98a46498f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:49.025063 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c9c02-b446-4a01-957e-f98a46498f72 admin admin] PATH_INFO: `/v3/projects/49967722c2c74bebaeb1ba17d2e9882a/users/0def618d7b5b403fb7b581384237c15e/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:49.057335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c9c02-b446-4a01-957e-f98a46498f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49967722c2c74bebaeb1ba17d2e9882a, user_id=0def618d7b5b403fb7b581384237c15e, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:49.060492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c9c02-b446-4a01-957e-f98a46498f72 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:49.077902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1300/2603] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:38:49 2022] PUT /identity/v3/projects/49967722c2c74bebaeb1ba17d2e9882a/users/0def618d7b5b403fb7b581384237c15e/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:49.088454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e149-cf51-4239-a09c-7333eeebae0b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:49.088747 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e149-cf51-4239-a09c-7333eeebae0b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:49.089049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e149-cf51-4239-a09c-7333eeebae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:49.116890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-db89e149-cf51-4239-a09c-7333eeebae0b None None] MFA Rules not processed for user `0def618d7b5b403fb7b581384237c15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:49.118129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-db89e149-cf51-4239-a09c-7333eeebae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:49.187809 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1304/2604] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:49.200842 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c9c02-b446-4a01-957e-f98a46498f72 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:49.202701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2a3c9c02-b446-4a01-957e-f98a46498f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:49.276149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c9c02-b446-4a01-957e-f98a46498f72 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:49.280472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d9dce-24af-49ad-ac0a-707c66ead475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:49.281138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d9dce-24af-49ad-ac0a-707c66ead475 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:49.281425 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d9dce-24af-49ad-ac0a-707c66ead475 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:49.281698 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d9dce-24af-49ad-ac0a-707c66ead475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:49.291632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d9dce-24af-49ad-ac0a-707c66ead475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:49.298730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d9dce-24af-49ad-ac0a-707c66ead475 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:49.314064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1301/2605] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:49.333888 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89e149-cf51-4239-a09c-7333eeebae0b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:49.406017 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89e149-cf51-4239-a09c-7333eeebae0b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:49.413787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:49.415499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:49.415977 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:49.416530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] PATH_INFO: `/v3/users/0def618d7b5b403fb7b581384237c15e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:49.418362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0def618d7b5b403fb7b581384237c15e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:49.420767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:49.422661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:49.480201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0def618d7b5b403fb7b581384237c15e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:49.480920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0def618d7b5b403fb7b581384237c15e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:49.492574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0def618d7b5b403fb7b581384237c15e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:49.493198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0def618d7b5b403fb7b581384237c15e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:49.500913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0def618d7b5b403fb7b581384237c15e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:49.516243 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1305/2606] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:38:49 2022] DELETE /identity/v3/users/0def618d7b5b403fb7b581384237c15e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:49.521052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc139c-7cd9-4265-960b-379de5e89ce9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:49.521372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc139c-7cd9-4265-960b-379de5e89ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:49.521662 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc139c-7cd9-4265-960b-379de5e89ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:49.548734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d5cc139c-7cd9-4265-960b-379de5e89ce9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:49.549988 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d5cc139c-7cd9-4265-960b-379de5e89ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:49.575281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:49.622109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1302/2607] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:49.633001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:49.634790 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:49.698735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968283ad-c366-44da-a7a5-a6b2e0025d49 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:49.702680 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3301eb-8041-406c-82d9-c376672d00fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:49.703359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3301eb-8041-406c-82d9-c376672d00fe service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:49.703647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3301eb-8041-406c-82d9-c376672d00fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:49.703906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3301eb-8041-406c-82d9-c376672d00fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:49.714055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3301eb-8041-406c-82d9-c376672d00fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:49.715798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3301eb-8041-406c-82d9-c376672d00fe service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:49.726115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1306/2608] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:50.027494 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc139c-7cd9-4265-960b-379de5e89ce9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:50.031706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d5cc139c-7cd9-4265-960b-379de5e89ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:50.049124 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc139c-7cd9-4265-960b-379de5e89ce9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:50.072257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:50.073644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.074353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.075081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] PATH_INFO: `/v3/projects/49967722c2c74bebaeb1ba17d2e9882a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.077704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49967722c2c74bebaeb1ba17d2e9882a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:50.080166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:50.141354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49967722c2c74bebaeb1ba17d2e9882a', 'request_id': 'req-1d4c400a-737d-4aa9-a9a2-414bf7b88544'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:50.146889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49967722c2c74bebaeb1ba17d2e9882a', 'request_id': 'req-1d4c400a-737d-4aa9-a9a2-414bf7b88544'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:50.153689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49967722c2c74bebaeb1ba17d2e9882a', 'request_id': 'req-1d4c400a-737d-4aa9-a9a2-414bf7b88544'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:50.168181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] The token cache is being invalidate because project 49967722c2c74bebaeb1ba17d2e9882a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:38:50.168616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:50.169274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1d4c400a-737d-4aa9-a9a2-414bf7b88544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:50.170896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1303/2609] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:38:50 2022] DELETE /identity/v3/projects/49967722c2c74bebaeb1ba17d2e9882a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:50.176113 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8f7b-a0ca-4c73-97c3-b2df706fb3a2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.176844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8f7b-a0ca-4c73-97c3-b2df706fb3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.177294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8f7b-a0ca-4c73-97c3-b2df706fb3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.201870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b0be8f7b-a0ca-4c73-97c3-b2df706fb3a2 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:50.203103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b0be8f7b-a0ca-4c73-97c3-b2df706fb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:50.268177 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1307/2610] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:38:50.277656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462a2e4-1b7e-41e9-b644-85de8d4b22fc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.278007 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462a2e4-1b7e-41e9-b644-85de8d4b22fc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.278315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462a2e4-1b7e-41e9-b644-85de8d4b22fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.305299 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9462a2e4-1b7e-41e9-b644-85de8d4b22fc None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:50.306535 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9462a2e4-1b7e-41e9-b644-85de8d4b22fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:50.315763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1304/2611] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:50.319908 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8f7b-a0ca-4c73-97c3-b2df706fb3a2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:50.330080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8f7b-a0ca-4c73-97c3-b2df706fb3a2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:50.334748 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2cc6c-aca5-4db8-b9ce-921e99a04e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:50.335415 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2cc6c-aca5-4db8-b9ce-921e99a04e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.335700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2cc6c-aca5-4db8-b9ce-921e99a04e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.335977 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2cc6c-aca5-4db8-b9ce-921e99a04e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.336773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2cc6c-aca5-4db8-b9ce-921e99a04e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:38:50.337081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2cc6c-aca5-4db8-b9ce-921e99a04e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:50.338699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2cc6c-aca5-4db8-b9ce-921e99a04e22 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:50.351689 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1308/2612] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:38:50.356156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462a2e4-1b7e-41e9-b644-85de8d4b22fc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:50.365883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462a2e4-1b7e-41e9-b644-85de8d4b22fc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:50.371290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44e22-39f3-45f0-8c5e-8407ce88ea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:50.372368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44e22-39f3-45f0-8c5e-8407ce88ea61 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.372368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44e22-39f3-45f0-8c5e-8407ce88ea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.372562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44e22-39f3-45f0-8c5e-8407ce88ea61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.373226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44e22-39f3-45f0-8c5e-8407ce88ea61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:50.375155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44e22-39f3-45f0-8c5e-8407ce88ea61 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:50.403171 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1305/2613] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:38:50 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:50.407355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2cc6c-aca5-4db8-b9ce-921e99a04e22 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:50.417648 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2cc6c-aca5-4db8-b9ce-921e99a04e22 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:50.422335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:50.479444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd140f0d-0c4e-4324-ab6e-5be8080d9539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:50.480292 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd140f0d-0c4e-4324-ab6e-5be8080d9539 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.480603 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd140f0d-0c4e-4324-ab6e-5be8080d9539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.480989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd140f0d-0c4e-4324-ab6e-5be8080d9539 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.482012 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd140f0d-0c4e-4324-ab6e-5be8080d9539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:50.483938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd140f0d-0c4e-4324-ab6e-5be8080d9539 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:50.510175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1309/2614] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:38:50 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:50.511273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44e22-39f3-45f0-8c5e-8407ce88ea61 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:50.525554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44e22-39f3-45f0-8c5e-8407ce88ea61 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:50.531669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d909-751d-4dcb-b9fc-ad4e550583c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:50.532590 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d909-751d-4dcb-b9fc-ad4e550583c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.532874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d909-751d-4dcb-b9fc-ad4e550583c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.533496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203d909-751d-4dcb-b9fc-ad4e550583c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.534240 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d909-751d-4dcb-b9fc-ad4e550583c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:50.535884 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203d909-751d-4dcb-b9fc-ad4e550583c3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:50.547557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1306/2615] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:38:50.552668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd140f0d-0c4e-4324-ab6e-5be8080d9539 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:50.564263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd140f0d-0c4e-4324-ab6e-5be8080d9539 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:50.569783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e318c5c-b15e-4d7a-8d45-dc49b8cc0934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:50.570641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e318c5c-b15e-4d7a-8d45-dc49b8cc0934 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.570927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e318c5c-b15e-4d7a-8d45-dc49b8cc0934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.571208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e318c5c-b15e-4d7a-8d45-dc49b8cc0934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.571950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e318c5c-b15e-4d7a-8d45-dc49b8cc0934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:50.573621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e318c5c-b15e-4d7a-8d45-dc49b8cc0934 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:50.585348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1310/2616] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:50.589516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d909-751d-4dcb-b9fc-ad4e550583c3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:50.599434 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203d909-751d-4dcb-b9fc-ad4e550583c3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:50.603985 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e842b95-4970-49ce-a111-c186781b3b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:50.604916 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e842b95-4970-49ce-a111-c186781b3b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.605195 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e842b95-4970-49ce-a111-c186781b3b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.605532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e842b95-4970-49ce-a111-c186781b3b85 admin admin] PATH_INFO: `/v3/projects/3fdbc6f63aba40fba2526ef9426815c3/users/50c230d1dea940afbf1ca28a233a4098/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.621210 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e842b95-4970-49ce-a111-c186781b3b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdbc6f63aba40fba2526ef9426815c3, user_id=50c230d1dea940afbf1ca28a233a4098, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:50.623889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e842b95-4970-49ce-a111-c186781b3b85 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:50.641713 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1307/2617] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:38:50 2022] PUT /identity/v3/projects/3fdbc6f63aba40fba2526ef9426815c3/users/50c230d1dea940afbf1ca28a233a4098/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:50.652080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045a19e-511a-4612-b90b-8ed0f124390e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.652412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045a19e-511a-4612-b90b-8ed0f124390e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.652698 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045a19e-511a-4612-b90b-8ed0f124390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.679431 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2045a19e-511a-4612-b90b-8ed0f124390e None None] MFA Rules not processed for user `50c230d1dea940afbf1ca28a233a4098`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:50.680805 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2045a19e-511a-4612-b90b-8ed0f124390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:50.747536 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1311/2618] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:50.758967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e842b95-4970-49ce-a111-c186781b3b85 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:50.760727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2e842b95-4970-49ce-a111-c186781b3b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:50.814463 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:50.821717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e842b95-4970-49ce-a111-c186781b3b85 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:50.828769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d509ec-06e3-40f9-ae4c-4028c56e1d26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:50.829457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d509ec-06e3-40f9-ae4c-4028c56e1d26 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:50.829746 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d509ec-06e3-40f9-ae4c-4028c56e1d26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:50.830024 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d509ec-06e3-40f9-ae4c-4028c56e1d26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:50.840462 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d509ec-06e3-40f9-ae4c-4028c56e1d26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:50.842170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d509ec-06e3-40f9-ae4c-4028c56e1d26 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:50.853450 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1308/2619] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:51.185575 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045a19e-511a-4612-b90b-8ed0f124390e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:51.187015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2045a19e-511a-4612-b90b-8ed0f124390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:51.266772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045a19e-511a-4612-b90b-8ed0f124390e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:51.271172 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52302ac1-13b4-4a8f-861c-4dbc5b6b02e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:51.271890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302ac1-13b4-4a8f-861c-4dbc5b6b02e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:51.272227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302ac1-13b4-4a8f-861c-4dbc5b6b02e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:51.272494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52302ac1-13b4-4a8f-861c-4dbc5b6b02e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:51.274438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-52302ac1-13b4-4a8f-861c-4dbc5b6b02e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:51.313821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:51.379625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52302ac1-13b4-4a8f-861c-4dbc5b6b02e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:51.381077 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52302ac1-13b4-4a8f-861c-4dbc5b6b02e1 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:51.398129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1312/2620] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:52.601603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d509ec-06e3-40f9-ae4c-4028c56e1d26 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:52.603137 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-72d509ec-06e3-40f9-ae4c-4028c56e1d26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:52.616946 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d509ec-06e3-40f9-ae4c-4028c56e1d26 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:52.620764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab4d69-5dc5-4c3f-9ceb-dc872bdd2863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:52.621427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab4d69-5dc5-4c3f-9ceb-dc872bdd2863 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:52.621835 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab4d69-5dc5-4c3f-9ceb-dc872bdd2863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:52.622736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab4d69-5dc5-4c3f-9ceb-dc872bdd2863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:52.625146 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-03ab4d69-5dc5-4c3f-9ceb-dc872bdd2863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:52.642936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab4d69-5dc5-4c3f-9ceb-dc872bdd2863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:52.644460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab4d69-5dc5-4c3f-9ceb-dc872bdd2863 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:52.659174 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1309/2621] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:54.054580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52302ac1-13b4-4a8f-861c-4dbc5b6b02e1 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:54.117708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52302ac1-13b4-4a8f-861c-4dbc5b6b02e1 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:54.122687 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:54.123587 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:54.123868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:54.124189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] PATH_INFO: `/v3/users/50c230d1dea940afbf1ca28a233a4098` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:54.125383 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c230d1dea940afbf1ca28a233a4098)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:54.127319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:54.190064 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c230d1dea940afbf1ca28a233a4098'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:54.190775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c230d1dea940afbf1ca28a233a4098'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:54.204049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c230d1dea940afbf1ca28a233a4098'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:54.204707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c230d1dea940afbf1ca28a233a4098'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:54.211806 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c230d1dea940afbf1ca28a233a4098'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:54.228066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1313/2622] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:38:54 2022] DELETE /identity/v3/users/50c230d1dea940afbf1ca28a233a4098 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:38:54.232875 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398d727-1d60-4ade-8610-d6c8929c5c1f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:54.233410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398d727-1d60-4ade-8610-d6c8929c5c1f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:54.233518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398d727-1d60-4ade-8610-d6c8929c5c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:54.254197 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9398d727-1d60-4ade-8610-d6c8929c5c1f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:54.255358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9398d727-1d60-4ade-8610-d6c8929c5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:54.332466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1310/2623] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:54.342338 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:54.344028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:54.396206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:54.415753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a6cf8-e005-47a4-a95a-6ff3b62daf20 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:54.420929 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074676c1-761d-4685-b05e-3cf3bdf243a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:54.422098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074676c1-761d-4685-b05e-3cf3bdf243a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:54.422389 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074676c1-761d-4685-b05e-3cf3bdf243a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:54.422660 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074676c1-761d-4685-b05e-3cf3bdf243a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:54.433096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074676c1-761d-4685-b05e-3cf3bdf243a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:54.434739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074676c1-761d-4685-b05e-3cf3bdf243a6 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:54.446069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1314/2624] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:38:54.736999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398d727-1d60-4ade-8610-d6c8929c5c1f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:54.738581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9398d727-1d60-4ade-8610-d6c8929c5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:54.751218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398d727-1d60-4ade-8610-d6c8929c5c1f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:54.755814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:54.756895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:54.757156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:54.757422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] PATH_INFO: `/v3/projects/3fdbc6f63aba40fba2526ef9426815c3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:54.758675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fdbc6f63aba40fba2526ef9426815c3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:54.760685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:54.813882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdbc6f63aba40fba2526ef9426815c3', 'request_id': 'req-0a9a526d-d082-4ff3-ac53-03de911bac8c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:54.819677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdbc6f63aba40fba2526ef9426815c3', 'request_id': 'req-0a9a526d-d082-4ff3-ac53-03de911bac8c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:54.826617 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdbc6f63aba40fba2526ef9426815c3', 'request_id': 'req-0a9a526d-d082-4ff3-ac53-03de911bac8c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:54.842030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] The token cache is being invalidate because project 3fdbc6f63aba40fba2526ef9426815c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:38:54.842315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:54.842938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0a9a526d-d082-4ff3-ac53-03de911bac8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:38:54.847523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1311/2625] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:38:54 2022] DELETE /identity/v3/projects/3fdbc6f63aba40fba2526ef9426815c3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:54.852563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d3152-0cec-428d-8fc6-2d4d421d0f73 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:54.852858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d3152-0cec-428d-8fc6-2d4d421d0f73 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:54.853140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d3152-0cec-428d-8fc6-2d4d421d0f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:54.873556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4b4d3152-0cec-428d-8fc6-2d4d421d0f73 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:54.874844 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4b4d3152-0cec-428d-8fc6-2d4d421d0f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:54.940297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1315/2626] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:54.947906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a8d90-9f47-46b3-af22-92c5c00b9066 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:54.948270 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a8d90-9f47-46b3-af22-92c5c00b9066 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:54.948554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a8d90-9f47-46b3-af22-92c5c00b9066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:54.969583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f08a8d90-9f47-46b3-af22-92c5c00b9066 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:54.970823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f08a8d90-9f47-46b3-af22-92c5c00b9066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:54.978985 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1312/2627] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:54.983480 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d3152-0cec-428d-8fc6-2d4d421d0f73 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:54.993978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d3152-0cec-428d-8fc6-2d4d421d0f73 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:54.998965 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57b6a6-bfb8-49ae-b273-a175eec878d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:54.999721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57b6a6-bfb8-49ae-b273-a175eec878d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:55.000059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57b6a6-bfb8-49ae-b273-a175eec878d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:55.000369 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57b6a6-bfb8-49ae-b273-a175eec878d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:55.001236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57b6a6-bfb8-49ae-b273-a175eec878d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:38:55.001583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57b6a6-bfb8-49ae-b273-a175eec878d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:55.003207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57b6a6-bfb8-49ae-b273-a175eec878d3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:55.015523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1316/2628] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:38:55.020182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a8d90-9f47-46b3-af22-92c5c00b9066 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:55.029426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a8d90-9f47-46b3-af22-92c5c00b9066 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:55.034768 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f96fe-5692-47cf-8e68-f10b55729d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:55.035426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f96fe-5692-47cf-8e68-f10b55729d56 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:55.035711 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f96fe-5692-47cf-8e68-f10b55729d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:55.035989 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f96fe-5692-47cf-8e68-f10b55729d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:55.036720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f96fe-5692-47cf-8e68-f10b55729d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:55.039176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f96fe-5692-47cf-8e68-f10b55729d56 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:55.072476 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1313/2629] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:38:55 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:55.076851 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57b6a6-bfb8-49ae-b273-a175eec878d3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:55.088190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57b6a6-bfb8-49ae-b273-a175eec878d3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:55.180607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1061-5729-417e-8d44-e1b4c7558c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:55.181297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1061-5729-417e-8d44-e1b4c7558c60 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:55.181612 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1061-5729-417e-8d44-e1b4c7558c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:55.181856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1061-5729-417e-8d44-e1b4c7558c60 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:55.182605 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d1061-5729-417e-8d44-e1b4c7558c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:55.185394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d1061-5729-417e-8d44-e1b4c7558c60 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:55.228725 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1317/2630] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:38:55 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:38:55.230093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f96fe-5692-47cf-8e68-f10b55729d56 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:55.241152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f96fe-5692-47cf-8e68-f10b55729d56 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:55.246221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c42e8-f20e-41da-9667-eaa39b0ba8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:55.247049 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c42e8-f20e-41da-9667-eaa39b0ba8db admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:55.247639 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c42e8-f20e-41da-9667-eaa39b0ba8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:55.248200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c42e8-f20e-41da-9667-eaa39b0ba8db admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:55.249134 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c42e8-f20e-41da-9667-eaa39b0ba8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:55.260369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c42e8-f20e-41da-9667-eaa39b0ba8db admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:55.273280 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1314/2631] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:55.277306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1061-5729-417e-8d44-e1b4c7558c60 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:55.288044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1061-5729-417e-8d44-e1b4c7558c60 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:55.293130 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3dd40-bc11-4b85-aca2-771a8c2389ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:55.293856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3dd40-bc11-4b85-aca2-771a8c2389ce admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:55.294135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3dd40-bc11-4b85-aca2-771a8c2389ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:55.294601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3dd40-bc11-4b85-aca2-771a8c2389ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:55.295328 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3dd40-bc11-4b85-aca2-771a8c2389ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:55.296997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3dd40-bc11-4b85-aca2-771a8c2389ce admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:55.310854 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1318/2632] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:38:55.315117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c42e8-f20e-41da-9667-eaa39b0ba8db admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:55.325926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c42e8-f20e-41da-9667-eaa39b0ba8db admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:55.333808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c28d0-c0e9-4485-a460-eaea5d3928e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:55.334798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c28d0-c0e9-4485-a460-eaea5d3928e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:55.335081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c28d0-c0e9-4485-a460-eaea5d3928e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:55.335330 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c28d0-c0e9-4485-a460-eaea5d3928e6 admin admin] PATH_INFO: `/v3/projects/75a175ef8c0c427b97676beb374af619/users/5026170938044cdcb8d94b02d6d20869/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:55.361443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c28d0-c0e9-4485-a460-eaea5d3928e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a175ef8c0c427b97676beb374af619, user_id=5026170938044cdcb8d94b02d6d20869, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:55.364807 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c28d0-c0e9-4485-a460-eaea5d3928e6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:55.368797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:55.384411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1315/2633] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:38:55 2022] PUT /identity/v3/projects/75a175ef8c0c427b97676beb374af619/users/5026170938044cdcb8d94b02d6d20869/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:38:55.396259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74269e6-9be3-4f60-ae3e-00c693db0861 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:55.396523 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74269e6-9be3-4f60-ae3e-00c693db0861 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:55.396826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74269e6-9be3-4f60-ae3e-00c693db0861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:55.430774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f74269e6-9be3-4f60-ae3e-00c693db0861 None None] MFA Rules not processed for user `5026170938044cdcb8d94b02d6d20869`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:38:55.432046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f74269e6-9be3-4f60-ae3e-00c693db0861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:55.470060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:38:55.514837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1319/2634] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:38:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:38:55.527233 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c28d0-c0e9-4485-a460-eaea5d3928e6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:38:55.529186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fe7c28d0-c0e9-4485-a460-eaea5d3928e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:38:55.589900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c28d0-c0e9-4485-a460-eaea5d3928e6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:38:55.594092 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938b54c-7a46-4e2d-963b-3a323227e210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:38:55.594747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b54c-7a46-4e2d-963b-3a323227e210 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:38:55.595030 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b54c-7a46-4e2d-963b-3a323227e210 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:38:55.595304 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b54c-7a46-4e2d-963b-3a323227e210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:38:55.605819 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938b54c-7a46-4e2d-963b-3a323227e210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:38:55.607673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938b54c-7a46-4e2d-963b-3a323227e210 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:38:55.617838 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1316/2635] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:38:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:05.502360 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=11 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:05.613391 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=28 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:06.903739 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74269e6-9be3-4f60-ae3e-00c693db0861 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:06.977646 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74269e6-9be3-4f60-ae3e-00c693db0861 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:06.983475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:06.984404 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:06.984686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:06.984958 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] PATH_INFO: `/v3/users/5026170938044cdcb8d94b02d6d20869` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:06.986341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5026170938044cdcb8d94b02d6d20869)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:06.988337 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:07.040342 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5026170938044cdcb8d94b02d6d20869'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:07.041014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5026170938044cdcb8d94b02d6d20869'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:07.054651 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5026170938044cdcb8d94b02d6d20869'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:07.055435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5026170938044cdcb8d94b02d6d20869'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:07.062685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5026170938044cdcb8d94b02d6d20869'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:07.078286 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1320/2636] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:39:06 2022] DELETE /identity/v3/users/5026170938044cdcb8d94b02d6d20869 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:07.083219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59090305-b2e6-4bd7-af78-d9a66f430747 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:07.083716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59090305-b2e6-4bd7-af78-d9a66f430747 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:07.083920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59090305-b2e6-4bd7-af78-d9a66f430747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:07.102387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-59090305-b2e6-4bd7-af78-d9a66f430747 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:07.103677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-59090305-b2e6-4bd7-af78-d9a66f430747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:07.165284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1317/2637] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:07.174741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:07.176430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:07.239135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b579-b498-4b6c-b311-7f7b17c9456d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:07.243381 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cae34-ed42-4d0f-8b04-38b4ead30349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:07.244036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cae34-ed42-4d0f-8b04-38b4ead30349 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:07.244333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cae34-ed42-4d0f-8b04-38b4ead30349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:07.244607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cae34-ed42-4d0f-8b04-38b4ead30349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:07.254281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cae34-ed42-4d0f-8b04-38b4ead30349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:07.255837 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cae34-ed42-4d0f-8b04-38b4ead30349 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:07.265454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1321/2638] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:07.542224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59090305-b2e6-4bd7-af78-d9a66f430747 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:07.543787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-59090305-b2e6-4bd7-af78-d9a66f430747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:07.558089 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59090305-b2e6-4bd7-af78-d9a66f430747 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:07.563443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:07.564418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:07.564702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:07.564982 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] PATH_INFO: `/v3/projects/75a175ef8c0c427b97676beb374af619` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:07.566231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a175ef8c0c427b97676beb374af619)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:07.568498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:07.625136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a175ef8c0c427b97676beb374af619', 'request_id': 'req-43fd5397-c990-4cc2-8325-31144317f424'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:07.632318 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a175ef8c0c427b97676beb374af619', 'request_id': 'req-43fd5397-c990-4cc2-8325-31144317f424'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:07.638689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a175ef8c0c427b97676beb374af619', 'request_id': 'req-43fd5397-c990-4cc2-8325-31144317f424'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:07.652832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] The token cache is being invalidate because project 75a175ef8c0c427b97676beb374af619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:39:07.653118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:07.653735 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-43fd5397-c990-4cc2-8325-31144317f424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:07.655321 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1318/2639] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:39:07 2022] DELETE /identity/v3/projects/75a175ef8c0c427b97676beb374af619 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:07.662140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5efc-11d8-43e4-ae92-b19ab779927d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:07.662424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5efc-11d8-43e4-ae92-b19ab779927d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:07.662721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5efc-11d8-43e4-ae92-b19ab779927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:07.816272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-475b5efc-11d8-43e4-ae92-b19ab779927d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:07.817568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-475b5efc-11d8-43e4-ae92-b19ab779927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:07.837820 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:07.883096 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1322/2640] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:07.891369 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393b73-356e-49dd-b89f-af92531d55d0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:07.891663 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393b73-356e-49dd-b89f-af92531d55d0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:07.891941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b393b73-356e-49dd-b89f-af92531d55d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:07.912045 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9b393b73-356e-49dd-b89f-af92531d55d0 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:07.913297 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9b393b73-356e-49dd-b89f-af92531d55d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:07.922750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1319/2641] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:07.927211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5efc-11d8-43e4-ae92-b19ab779927d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:07.937114 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5efc-11d8-43e4-ae92-b19ab779927d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:07.942297 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3332f0-d35a-49ca-a47f-20543b338787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:07.943126 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3332f0-d35a-49ca-a47f-20543b338787 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:07.943408 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3332f0-d35a-49ca-a47f-20543b338787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:07.943675 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3332f0-d35a-49ca-a47f-20543b338787 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:07.944410 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3332f0-d35a-49ca-a47f-20543b338787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:39:07.944711 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3332f0-d35a-49ca-a47f-20543b338787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:07.946314 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3332f0-d35a-49ca-a47f-20543b338787 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:07.958312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1323/2642] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:39:07.962641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b393b73-356e-49dd-b89f-af92531d55d0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:07.973523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b393b73-356e-49dd-b89f-af92531d55d0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:07.978822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11107d7-9101-4e68-90a9-63e206d02210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:07.979518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11107d7-9101-4e68-90a9-63e206d02210 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:07.979797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11107d7-9101-4e68-90a9-63e206d02210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:07.980094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11107d7-9101-4e68-90a9-63e206d02210 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:07.980789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11107d7-9101-4e68-90a9-63e206d02210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:07.982700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11107d7-9101-4e68-90a9-63e206d02210 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:08.010593 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1320/2643] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:39:07 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:08.014915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3332f0-d35a-49ca-a47f-20543b338787 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:08.025405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3332f0-d35a-49ca-a47f-20543b338787 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:08.086738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6586d8-9824-4704-9144-fcf7e0666c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:08.087325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6586d8-9824-4704-9144-fcf7e0666c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:08.087589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6586d8-9824-4704-9144-fcf7e0666c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:08.087882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6586d8-9824-4704-9144-fcf7e0666c68 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:08.088600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6586d8-9824-4704-9144-fcf7e0666c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:08.090800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6586d8-9824-4704-9144-fcf7e0666c68 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:08.115699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1324/2644] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:39:08 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:08.120033 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11107d7-9101-4e68-90a9-63e206d02210 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:08.131088 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11107d7-9101-4e68-90a9-63e206d02210 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:08.136864 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c817b-fc9c-4839-bba7-2851d045e4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:08.137527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c817b-fc9c-4839-bba7-2851d045e4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:08.137806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c817b-fc9c-4839-bba7-2851d045e4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:08.138074 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c817b-fc9c-4839-bba7-2851d045e4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:08.138800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c817b-fc9c-4839-bba7-2851d045e4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:08.140456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c817b-fc9c-4839-bba7-2851d045e4e4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:08.151385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1321/2645] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:39:08.155402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6586d8-9824-4704-9144-fcf7e0666c68 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:08.165924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6586d8-9824-4704-9144-fcf7e0666c68 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:08.170719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c704d01-b369-40fc-af98-1fac0535a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:08.171367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c704d01-b369-40fc-af98-1fac0535a748 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:08.171644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c704d01-b369-40fc-af98-1fac0535a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:08.171917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c704d01-b369-40fc-af98-1fac0535a748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:08.172670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c704d01-b369-40fc-af98-1fac0535a748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:08.174225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c704d01-b369-40fc-af98-1fac0535a748 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:08.184125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1325/2646] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:08.188560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c817b-fc9c-4839-bba7-2851d045e4e4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:08.199646 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c817b-fc9c-4839-bba7-2851d045e4e4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:08.204557 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b57055-2807-4148-a416-dad743832674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:08.205457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b57055-2807-4148-a416-dad743832674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:08.205757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b57055-2807-4148-a416-dad743832674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:08.206014 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b57055-2807-4148-a416-dad743832674 admin admin] PATH_INFO: `/v3/projects/b1701547610945ceac41e94e733f61a1/users/308d60778a0e489491cd6b3a79c96385/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:08.220940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b57055-2807-4148-a416-dad743832674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1701547610945ceac41e94e733f61a1, user_id=308d60778a0e489491cd6b3a79c96385, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:08.223601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b57055-2807-4148-a416-dad743832674 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:08.239806 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1322/2647] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:08 2022] PUT /identity/v3/projects/b1701547610945ceac41e94e733f61a1/users/308d60778a0e489491cd6b3a79c96385/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:08.244771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24765-e01a-4654-ac06-4698c9a8f8fe None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:08.245059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24765-e01a-4654-ac06-4698c9a8f8fe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:08.245455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24765-e01a-4654-ac06-4698c9a8f8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:08.263377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fba24765-e01a-4654-ac06-4698c9a8f8fe None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:08.264614 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fba24765-e01a-4654-ac06-4698c9a8f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:08.337588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1326/2648] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:08.347126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b57055-2807-4148-a416-dad743832674 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:08.349054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-90b57055-2807-4148-a416-dad743832674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:08.376149 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:08.415294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b57055-2807-4148-a416-dad743832674 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:08.418942 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2a65-aff2-4069-a992-3dd5317a3062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:08.419589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2a65-aff2-4069-a992-3dd5317a3062 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:08.419877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2a65-aff2-4069-a992-3dd5317a3062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:08.420179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2a65-aff2-4069-a992-3dd5317a3062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:08.433375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2a65-aff2-4069-a992-3dd5317a3062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:08.434865 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2a65-aff2-4069-a992-3dd5317a3062 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:08.444635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1323/2649] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:12.553652 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56d8b2-8a48-4980-8257-ecb1e864ca06 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:12.554190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56d8b2-8a48-4980-8257-ecb1e864ca06 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:12.554190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56d8b2-8a48-4980-8257-ecb1e864ca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:12.581525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6b56d8b2-8a48-4980-8257-ecb1e864ca06 None None] MFA Rules not processed for user `308d60778a0e489491cd6b3a79c96385`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:12.582883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6b56d8b2-8a48-4980-8257-ecb1e864ca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:12.601047 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:12.693683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1327/2650] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:12.698466 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2a65-aff2-4069-a992-3dd5317a3062 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:12.711681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2a65-aff2-4069-a992-3dd5317a3062 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:12.716764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ada3b4-2600-40ff-84d1-4da64f50e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:12.717429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada3b4-2600-40ff-84d1-4da64f50e44a admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:12.717705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada3b4-2600-40ff-84d1-4da64f50e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:12.717957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ada3b4-2600-40ff-84d1-4da64f50e44a admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:12.718656 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ada3b4-2600-40ff-84d1-4da64f50e44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:12.720608 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ada3b4-2600-40ff-84d1-4da64f50e44a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:12.760042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1324/2651] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:39:12 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:12.764163 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56d8b2-8a48-4980-8257-ecb1e864ca06 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:12.775380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56d8b2-8a48-4980-8257-ecb1e864ca06 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:12.838953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c7fb6-cf21-4122-8c86-af4decf75311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:12.839847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c7fb6-cf21-4122-8c86-af4decf75311 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:12.840147 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c7fb6-cf21-4122-8c86-af4decf75311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:12.840424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c7fb6-cf21-4122-8c86-af4decf75311 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:12.841138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c7fb6-cf21-4122-8c86-af4decf75311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:12.843313 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c7fb6-cf21-4122-8c86-af4decf75311 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:12.869099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1328/2652] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:39:12 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:39:12.870569 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ada3b4-2600-40ff-84d1-4da64f50e44a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:12.881286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ada3b4-2600-40ff-84d1-4da64f50e44a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:12.886090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3307c-b9eb-43c7-b177-c46cca9476f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:12.886786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3307c-b9eb-43c7-b177-c46cca9476f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:12.887069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3307c-b9eb-43c7-b177-c46cca9476f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:12.887342 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3307c-b9eb-43c7-b177-c46cca9476f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:12.888114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3307c-b9eb-43c7-b177-c46cca9476f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:12.889792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3307c-b9eb-43c7-b177-c46cca9476f2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:12.908169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1325/2653] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:12.913351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c7fb6-cf21-4122-8c86-af4decf75311 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:12.925626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c7fb6-cf21-4122-8c86-af4decf75311 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:12.931912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588297ce-6f01-4dd1-9fb0-3b3803e6ae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:12.932887 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588297ce-6f01-4dd1-9fb0-3b3803e6ae4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:12.933144 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588297ce-6f01-4dd1-9fb0-3b3803e6ae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:12.933423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588297ce-6f01-4dd1-9fb0-3b3803e6ae4d admin admin] PATH_INFO: `/v3/projects/b73439ed6bab4bcfb172b669543c1c6b/users/d4b5b3c24e014b5ea7f3baf7868e18ee/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:12.951389 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588297ce-6f01-4dd1-9fb0-3b3803e6ae4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73439ed6bab4bcfb172b669543c1c6b, user_id=d4b5b3c24e014b5ea7f3baf7868e18ee, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:12.954191 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588297ce-6f01-4dd1-9fb0-3b3803e6ae4d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:12.971160 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1329/2654] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:12 2022] PUT /identity/v3/projects/b73439ed6bab4bcfb172b669543c1c6b/users/d4b5b3c24e014b5ea7f3baf7868e18ee/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:12.975316 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3307c-b9eb-43c7-b177-c46cca9476f2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:12.986324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3307c-b9eb-43c7-b177-c46cca9476f2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:13.050308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cd1ee-81ef-4b66-815c-486c921b4adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:13.050995 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cd1ee-81ef-4b66-815c-486c921b4adc admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:13.051320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cd1ee-81ef-4b66-815c-486c921b4adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:13.051598 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cd1ee-81ef-4b66-815c-486c921b4adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:13.052372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cd1ee-81ef-4b66-815c-486c921b4adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:13.054001 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cd1ee-81ef-4b66-815c-486c921b4adc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:13.065019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1326/2655] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:13.069380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588297ce-6f01-4dd1-9fb0-3b3803e6ae4d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:13.081502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588297ce-6f01-4dd1-9fb0-3b3803e6ae4d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:13.087617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea15c4-f3a7-4e01-b2cb-597393f431b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:13.088609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea15c4-f3a7-4e01-b2cb-597393f431b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:13.089447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea15c4-f3a7-4e01-b2cb-597393f431b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:13.089447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea15c4-f3a7-4e01-b2cb-597393f431b9 admin admin] PATH_INFO: `/v3/projects/b73439ed6bab4bcfb172b669543c1c6b/users/d4b5b3c24e014b5ea7f3baf7868e18ee/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:13.091223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea15c4-f3a7-4e01-b2cb-597393f431b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73439ed6bab4bcfb172b669543c1c6b, user_id=d4b5b3c24e014b5ea7f3baf7868e18ee, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:13.098752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea15c4-f3a7-4e01-b2cb-597393f431b9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:13.111522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1330/2656] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:13 2022] PUT /identity/v3/projects/b73439ed6bab4bcfb172b669543c1c6b/users/d4b5b3c24e014b5ea7f3baf7868e18ee/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:15.726271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cd1ee-81ef-4b66-815c-486c921b4adc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:15.915660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cd1ee-81ef-4b66-815c-486c921b4adc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:16.023496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:16.055945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a69ca-9a7e-4805-b16a-af4194c21621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:16.056951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a69ca-9a7e-4805-b16a-af4194c21621 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:16.057490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a69ca-9a7e-4805-b16a-af4194c21621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:16.057987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a69ca-9a7e-4805-b16a-af4194c21621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:16.071862 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3f9a69ca-9a7e-4805-b16a-af4194c21621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:16.098640 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a69ca-9a7e-4805-b16a-af4194c21621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:16.101417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a69ca-9a7e-4805-b16a-af4194c21621 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:16.113543 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1327/2657] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:18.082396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd7ff-8699-4c02-99c8-80fb28946935 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:18.083137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd7ff-8699-4c02-99c8-80fb28946935 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:18.083422 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dd7ff-8699-4c02-99c8-80fb28946935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:18.112783 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8f0dd7ff-8699-4c02-99c8-80fb28946935 None None] MFA Rules not processed for user `d4b5b3c24e014b5ea7f3baf7868e18ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:18.114186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8f0dd7ff-8699-4c02-99c8-80fb28946935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:18.118604 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7d78e-e7b6-4cc4-ae91-4c1f1d719213 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:18.119176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7d78e-e7b6-4cc4-ae91-4c1f1d719213 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:18.119378 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7d78e-e7b6-4cc4-ae91-4c1f1d719213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:18.139231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f3e7d78e-e7b6-4cc4-ae91-4c1f1d719213 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:18.140672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f3e7d78e-e7b6-4cc4-ae91-4c1f1d719213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:18.186729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:18.200124 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1331/2658] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:18.214328 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dd7ff-8699-4c02-99c8-80fb28946935 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:18.215911 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1328/2659] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 4 18:39:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:39:18.216115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8f0dd7ff-8699-4c02-99c8-80fb28946935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:18.229010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7d78e-e7b6-4cc4-ae91-4c1f1d719213 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:18.231050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f3e7d78e-e7b6-4cc4-ae91-4c1f1d719213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:18.305048 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dd7ff-8699-4c02-99c8-80fb28946935 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:18.313037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a372b-06c1-4801-9935-2f72f3ee2d1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:18.313724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a372b-06c1-4801-9935-2f72f3ee2d1f service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:18.313989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a372b-06c1-4801-9935-2f72f3ee2d1f service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:18.314721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a372b-06c1-4801-9935-2f72f3ee2d1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:18.324802 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7d78e-e7b6-4cc4-ae91-4c1f1d719213 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:18.330772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0de4b-b468-48d7-8328-e7958108b284 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:18.331816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0de4b-b468-48d7-8328-e7958108b284 service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:18.332193 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0de4b-b468-48d7-8328-e7958108b284 service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:18.332607 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0de4b-b468-48d7-8328-e7958108b284 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:18.345998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0de4b-b468-48d7-8328-e7958108b284 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:18.347648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0de4b-b468-48d7-8328-e7958108b284 service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:18.356767 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1329/2660] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 18:39:18.393821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a372b-06c1-4801-9935-2f72f3ee2d1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:18.397412 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a372b-06c1-4801-9935-2f72f3ee2d1f service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:18.417442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1332/2661] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:39:19.650945 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78627b-141e-40de-8ef0-8151a59dddd9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:19.651505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78627b-141e-40de-8ef0-8151a59dddd9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:19.651505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78627b-141e-40de-8ef0-8151a59dddd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:19.670615 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-db78627b-141e-40de-8ef0-8151a59dddd9 None None] MFA Rules not processed for user `308d60778a0e489491cd6b3a79c96385`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:19.671823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-db78627b-141e-40de-8ef0-8151a59dddd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:19.678920 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1330/2662] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:28.412287 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=58 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:29.664859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=67 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:36.764720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a372b-06c1-4801-9935-2f72f3ee2d1f service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:36.787363 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a372b-06c1-4801-9935-2f72f3ee2d1f service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:36.794595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a465b-c575-411d-949c-2d7dc8642bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:36.795268 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a465b-c575-411d-949c-2d7dc8642bd3 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:36.795548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a465b-c575-411d-949c-2d7dc8642bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:36.796487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a465b-c575-411d-949c-2d7dc8642bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:36.798482 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ab2a465b-c575-411d-949c-2d7dc8642bd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:36.813442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a465b-c575-411d-949c-2d7dc8642bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:36.814950 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a465b-c575-411d-949c-2d7dc8642bd3 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:36.840670 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1333/2663] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:42.383523 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78627b-141e-40de-8ef0-8151a59dddd9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:42.385188 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-db78627b-141e-40de-8ef0-8151a59dddd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:42.397020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78627b-141e-40de-8ef0-8151a59dddd9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:42.401113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d353f2-6412-4491-8964-e57a65e30a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:42.401872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d353f2-6412-4491-8964-e57a65e30a0c service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:42.402216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d353f2-6412-4491-8964-e57a65e30a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:42.402556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d353f2-6412-4491-8964-e57a65e30a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:42.405507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e4d353f2-6412-4491-8964-e57a65e30a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:42.469472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d353f2-6412-4491-8964-e57a65e30a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:42.470938 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d353f2-6412-4491-8964-e57a65e30a0c service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:42.481142 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1331/2664] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:39:43.082001 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a465b-c575-411d-949c-2d7dc8642bd3 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:43.084907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ab2a465b-c575-411d-949c-2d7dc8642bd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:43.166564 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a465b-c575-411d-949c-2d7dc8642bd3 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:43.171508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311210d9-0fd6-4742-b24e-078998cdd0f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:43.172189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311210d9-0fd6-4742-b24e-078998cdd0f9 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:43.172470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311210d9-0fd6-4742-b24e-078998cdd0f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:43.172740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311210d9-0fd6-4742-b24e-078998cdd0f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:43.174515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-311210d9-0fd6-4742-b24e-078998cdd0f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:43.186054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311210d9-0fd6-4742-b24e-078998cdd0f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:43.187735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311210d9-0fd6-4742-b24e-078998cdd0f9 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:43.199977 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1334/2665] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:46.396285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d353f2-6412-4491-8964-e57a65e30a0c service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:46.408133 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d353f2-6412-4491-8964-e57a65e30a0c service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:46.415464 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73dba0-a754-4081-a672-10d09ebd181e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:46.416164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73dba0-a754-4081-a672-10d09ebd181e service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:46.416448 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73dba0-a754-4081-a672-10d09ebd181e service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:46.416729 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73dba0-a754-4081-a672-10d09ebd181e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:46.418859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ef73dba0-a754-4081-a672-10d09ebd181e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:46.432066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73dba0-a754-4081-a672-10d09ebd181e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:46.433823 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73dba0-a754-4081-a672-10d09ebd181e service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:46.444898 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1332/2666] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:46.501405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311210d9-0fd6-4742-b24e-078998cdd0f9 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:46.503336 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-311210d9-0fd6-4742-b24e-078998cdd0f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:46.520548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311210d9-0fd6-4742-b24e-078998cdd0f9 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:46.525824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:46.526949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:46.527386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:46.527810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] PATH_INFO: `/v3/users/5b5a9f5cdfa6494d97617d68880d5552` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:46.529623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5a9f5cdfa6494d97617d68880d5552)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:46.533466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:46.618485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5a9f5cdfa6494d97617d68880d5552'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:46.619245 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5a9f5cdfa6494d97617d68880d5552'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:46.633206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5a9f5cdfa6494d97617d68880d5552'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:46.634662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5a9f5cdfa6494d97617d68880d5552'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:46.643618 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28b0072c-2910-42a4-8cd3-789be588aae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5a9f5cdfa6494d97617d68880d5552'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:46.668045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1335/2667] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:39:46 2022] DELETE /identity/v3/users/5b5a9f5cdfa6494d97617d68880d5552 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:46.861344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73dba0-a754-4081-a672-10d09ebd181e service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:46.873455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73dba0-a754-4081-a672-10d09ebd181e service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:46.936462 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:46.937358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:46.937643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:46.937924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] PATH_INFO: `/v3/projects/71dff5ee406141ec8e0d4a9b58106610` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:46.939117 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71dff5ee406141ec8e0d4a9b58106610)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:46.941281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:46.991699 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71dff5ee406141ec8e0d4a9b58106610', 'request_id': 'req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:46.997941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71dff5ee406141ec8e0d4a9b58106610', 'request_id': 'req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:47.004637 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71dff5ee406141ec8e0d4a9b58106610', 'request_id': 'req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:47.019773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] The token cache is being invalidate because project 71dff5ee406141ec8e0d4a9b58106610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:39:47.020093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:47.020771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c31acfd5-ae1c-4a3a-8854-ce3358712cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:47.022563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1333/2668] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:39:46 2022] DELETE /identity/v3/projects/71dff5ee406141ec8e0d4a9b58106610 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:47.027933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295b47a-745e-4b04-8457-4a1dd654f7b2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.028570 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295b47a-745e-4b04-8457-4a1dd654f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.028917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295b47a-745e-4b04-8457-4a1dd654f7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.049718 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4295b47a-745e-4b04-8457-4a1dd654f7b2 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:47.050846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4295b47a-745e-4b04-8457-4a1dd654f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:47.099326 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:47.116644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1336/2669] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:47.125817 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7813e1-6198-47cb-b929-28d1fdbe063f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.126109 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7813e1-6198-47cb-b929-28d1fdbe063f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.126385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7813e1-6198-47cb-b929-28d1fdbe063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.144697 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7e7813e1-6198-47cb-b929-28d1fdbe063f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:47.145878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7e7813e1-6198-47cb-b929-28d1fdbe063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:47.154825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1334/2670] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:47.159290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295b47a-745e-4b04-8457-4a1dd654f7b2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.169450 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295b47a-745e-4b04-8457-4a1dd654f7b2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:47.174897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294c374-37db-42a1-bfac-c4d677c0948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:47.175556 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294c374-37db-42a1-bfac-c4d677c0948f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.175831 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294c374-37db-42a1-bfac-c4d677c0948f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.176127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294c374-37db-42a1-bfac-c4d677c0948f admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.176857 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294c374-37db-42a1-bfac-c4d677c0948f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:39:47.177156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294c374-37db-42a1-bfac-c4d677c0948f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:47.178757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294c374-37db-42a1-bfac-c4d677c0948f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:47.190699 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1337/2671] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:39:47.194872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7813e1-6198-47cb-b929-28d1fdbe063f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.201311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:47.205456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7813e1-6198-47cb-b929-28d1fdbe063f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:47.211876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d1e7a-c895-42be-9d26-81876cd259fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:47.212583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d1e7a-c895-42be-9d26-81876cd259fe admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.213078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d1e7a-c895-42be-9d26-81876cd259fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.213589 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d1e7a-c895-42be-9d26-81876cd259fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.214542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d1e7a-c895-42be-9d26-81876cd259fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:47.216538 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d1e7a-c895-42be-9d26-81876cd259fe admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:47.249683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1335/2672] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:39:47 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:47.254029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294c374-37db-42a1-bfac-c4d677c0948f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.264549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294c374-37db-42a1-bfac-c4d677c0948f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:47.330192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e2bed-9640-42c1-96e2-f63864af52c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:47.330868 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e2bed-9640-42c1-96e2-f63864af52c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.331150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e2bed-9640-42c1-96e2-f63864af52c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.331426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e2bed-9640-42c1-96e2-f63864af52c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.332165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e2bed-9640-42c1-96e2-f63864af52c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:47.334099 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e2bed-9640-42c1-96e2-f63864af52c4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:47.357621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1338/2673] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:39:47 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:39:47.361824 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d1e7a-c895-42be-9d26-81876cd259fe admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.373263 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d1e7a-c895-42be-9d26-81876cd259fe admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:47.378752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffad00-7547-421a-8454-13e99e4cb498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:47.379410 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffad00-7547-421a-8454-13e99e4cb498 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.379688 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffad00-7547-421a-8454-13e99e4cb498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.380050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffad00-7547-421a-8454-13e99e4cb498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.380783 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffad00-7547-421a-8454-13e99e4cb498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:47.382392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffad00-7547-421a-8454-13e99e4cb498 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:47.393606 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1336/2674] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:47.398201 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e2bed-9640-42c1-96e2-f63864af52c4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.414316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e2bed-9640-42c1-96e2-f63864af52c4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:47.423426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85d74-5ac3-477d-a0fd-de69c63bf34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:47.424499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85d74-5ac3-477d-a0fd-de69c63bf34a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.424827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85d74-5ac3-477d-a0fd-de69c63bf34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.425133 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85d74-5ac3-477d-a0fd-de69c63bf34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.425904 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85d74-5ac3-477d-a0fd-de69c63bf34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:47.427958 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85d74-5ac3-477d-a0fd-de69c63bf34a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:47.443768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1339/2675] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:47.448878 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffad00-7547-421a-8454-13e99e4cb498 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.459744 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffad00-7547-421a-8454-13e99e4cb498 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:47.465987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b0949-5c0c-40ed-8da0-bddf81f02267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:47.466879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b0949-5c0c-40ed-8da0-bddf81f02267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.467159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b0949-5c0c-40ed-8da0-bddf81f02267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.467417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b0949-5c0c-40ed-8da0-bddf81f02267 admin admin] PATH_INFO: `/v3/projects/aaf006defbf54f99b3da3737618c53f7/users/8f411d710f2e4954ae7d0a1759704e03/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.482418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b0949-5c0c-40ed-8da0-bddf81f02267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf006defbf54f99b3da3737618c53f7, user_id=8f411d710f2e4954ae7d0a1759704e03, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:47.485144 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b0949-5c0c-40ed-8da0-bddf81f02267 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:47.499552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1337/2676] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:47 2022] PUT /identity/v3/projects/aaf006defbf54f99b3da3737618c53f7/users/8f411d710f2e4954ae7d0a1759704e03/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:47.510185 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec1e2-eee3-480a-a357-21f514d100cd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.510684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec1e2-eee3-480a-a357-21f514d100cd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.510793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec1e2-eee3-480a-a357-21f514d100cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.537328 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c83ec1e2-eee3-480a-a357-21f514d100cd None None] MFA Rules not processed for user `8f411d710f2e4954ae7d0a1759704e03`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:47.538497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c83ec1e2-eee3-480a-a357-21f514d100cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:47.616762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1340/2677] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:47.621428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b0949-5c0c-40ed-8da0-bddf81f02267 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.690993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b0949-5c0c-40ed-8da0-bddf81f02267 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:47.696872 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27313f59-e4d3-4d45-ac2d-72c81ae38e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:47.697597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313f59-e4d3-4d45-ac2d-72c81ae38e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.697937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313f59-e4d3-4d45-ac2d-72c81ae38e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.698218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313f59-e4d3-4d45-ac2d-72c81ae38e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.698922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27313f59-e4d3-4d45-ac2d-72c81ae38e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:47.700970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27313f59-e4d3-4d45-ac2d-72c81ae38e29 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:47.732246 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1338/2678] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:39:47 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:47.736423 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ec1e2-eee3-480a-a357-21f514d100cd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.747897 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ec1e2-eee3-480a-a357-21f514d100cd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:47.791164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:47.807729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc54d46-797a-4e21-97b5-0d820983189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:47.808441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc54d46-797a-4e21-97b5-0d820983189f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.808729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc54d46-797a-4e21-97b5-0d820983189f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.809005 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc54d46-797a-4e21-97b5-0d820983189f admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.809706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc54d46-797a-4e21-97b5-0d820983189f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:47.811638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc54d46-797a-4e21-97b5-0d820983189f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:47.833027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1341/2679] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:39:47 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:47.837390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27313f59-e4d3-4d45-ac2d-72c81ae38e29 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.848238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27313f59-e4d3-4d45-ac2d-72c81ae38e29 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:47.854629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ababdca-0f27-4ab7-8119-189b95428e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:47.855460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ababdca-0f27-4ab7-8119-189b95428e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.856081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ababdca-0f27-4ab7-8119-189b95428e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.856213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ababdca-0f27-4ab7-8119-189b95428e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.856961 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ababdca-0f27-4ab7-8119-189b95428e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:47.858658 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ababdca-0f27-4ab7-8119-189b95428e4b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:47.875849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1339/2680] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:47.879920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc54d46-797a-4e21-97b5-0d820983189f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.891563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc54d46-797a-4e21-97b5-0d820983189f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:47.897315 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703c23-1c5b-4337-a94c-12efe610b83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:47.898249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703c23-1c5b-4337-a94c-12efe610b83b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:47.898543 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703c23-1c5b-4337-a94c-12efe610b83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:47.898832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703c23-1c5b-4337-a94c-12efe610b83b admin admin] PATH_INFO: `/v3/projects/5b31fd17d6154c99ad1644ab0aeaf6c2/users/b0bf704ca07d47729dcb7c573d3c4dbc/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:47.918129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6703c23-1c5b-4337-a94c-12efe610b83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b31fd17d6154c99ad1644ab0aeaf6c2, user_id=b0bf704ca07d47729dcb7c573d3c4dbc, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:47.921030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6703c23-1c5b-4337-a94c-12efe610b83b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:47.939413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1342/2681] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:47 2022] PUT /identity/v3/projects/5b31fd17d6154c99ad1644ab0aeaf6c2/users/b0bf704ca07d47729dcb7c573d3c4dbc/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:47.943574 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ababdca-0f27-4ab7-8119-189b95428e4b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:47.959861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ababdca-0f27-4ab7-8119-189b95428e4b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:48.029239 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df678a-f754-4eba-9462-098bfc6f42ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:48.030097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df678a-f754-4eba-9462-098bfc6f42ff admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:48.030375 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df678a-f754-4eba-9462-098bfc6f42ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:48.030645 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df678a-f754-4eba-9462-098bfc6f42ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:48.031388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df678a-f754-4eba-9462-098bfc6f42ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:48.033054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df678a-f754-4eba-9462-098bfc6f42ff admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:48.045313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1340/2682] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:48.049411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703c23-1c5b-4337-a94c-12efe610b83b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:48.060520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703c23-1c5b-4337-a94c-12efe610b83b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:48.066307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16a3a9-d08e-4b35-8a8c-eb695d019bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:48.067213 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16a3a9-d08e-4b35-8a8c-eb695d019bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:48.067604 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16a3a9-d08e-4b35-8a8c-eb695d019bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:48.067874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16a3a9-d08e-4b35-8a8c-eb695d019bbb admin admin] PATH_INFO: `/v3/projects/5b31fd17d6154c99ad1644ab0aeaf6c2/users/b0bf704ca07d47729dcb7c573d3c4dbc/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:48.069852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16a3a9-d08e-4b35-8a8c-eb695d019bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b31fd17d6154c99ad1644ab0aeaf6c2, user_id=b0bf704ca07d47729dcb7c573d3c4dbc, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:48.072970 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16a3a9-d08e-4b35-8a8c-eb695d019bbb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:48.084413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1343/2683] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:48 2022] PUT /identity/v3/projects/5b31fd17d6154c99ad1644ab0aeaf6c2/users/b0bf704ca07d47729dcb7c573d3c4dbc/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:48.095486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0919-6ac2-4dcf-972d-193fdcd636b5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:48.095781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0919-6ac2-4dcf-972d-193fdcd636b5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:48.096077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0919-6ac2-4dcf-972d-193fdcd636b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:48.124428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c01d0919-6ac2-4dcf-972d-193fdcd636b5 None None] MFA Rules not processed for user `b0bf704ca07d47729dcb7c573d3c4dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:48.125587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c01d0919-6ac2-4dcf-972d-193fdcd636b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:48.130738 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:48.197860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1341/2684] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:48.209962 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16a3a9-d08e-4b35-8a8c-eb695d019bbb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:48.212333 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1b16a3a9-d08e-4b35-8a8c-eb695d019bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:48.271665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16a3a9-d08e-4b35-8a8c-eb695d019bbb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:48.275563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2a3fe-d857-4b4e-8cde-e5e21ad8fa9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:48.276253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2a3fe-d857-4b4e-8cde-e5e21ad8fa9a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:48.276562 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2a3fe-d857-4b4e-8cde-e5e21ad8fa9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:48.276832 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2a3fe-d857-4b4e-8cde-e5e21ad8fa9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:48.287329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2a3fe-d857-4b4e-8cde-e5e21ad8fa9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:48.288815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2a3fe-d857-4b4e-8cde-e5e21ad8fa9a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:48.307303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1344/2685] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:48.381848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0919-6ac2-4dcf-972d-193fdcd636b5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:48.392514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0919-6ac2-4dcf-972d-193fdcd636b5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:48.396674 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2797ee-d086-48e2-afb3-b23b465c5744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:48.397307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2797ee-d086-48e2-afb3-b23b465c5744 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:48.397596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2797ee-d086-48e2-afb3-b23b465c5744 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:48.397864 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2797ee-d086-48e2-afb3-b23b465c5744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:48.458259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2797ee-d086-48e2-afb3-b23b465c5744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:48.459851 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2797ee-d086-48e2-afb3-b23b465c5744 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:48.470110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1342/2686] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:51.234724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2a3fe-d857-4b4e-8cde-e5e21ad8fa9a service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:51.301367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2a3fe-d857-4b4e-8cde-e5e21ad8fa9a service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:51.306006 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:51.307105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:51.307105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:51.307408 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] PATH_INFO: `/v3/users/8f411d710f2e4954ae7d0a1759704e03` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:51.308684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f411d710f2e4954ae7d0a1759704e03)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:51.310610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:51.356367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:51.361614 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f411d710f2e4954ae7d0a1759704e03'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:51.362498 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f411d710f2e4954ae7d0a1759704e03'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:51.375443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f411d710f2e4954ae7d0a1759704e03'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:51.376183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f411d710f2e4954ae7d0a1759704e03'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:51.382892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f411d710f2e4954ae7d0a1759704e03'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:51.397781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1345/2687] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:39:51 2022] DELETE /identity/v3/users/8f411d710f2e4954ae7d0a1759704e03 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:51.402616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40499d00-3b5c-4c53-b228-5dab7231559f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:51.402616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40499d00-3b5c-4c53-b228-5dab7231559f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:51.403670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40499d00-3b5c-4c53-b228-5dab7231559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:51.420892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-40499d00-3b5c-4c53-b228-5dab7231559f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:51.422112 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-40499d00-3b5c-4c53-b228-5dab7231559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:51.488179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1343/2688] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:51.497487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:51.498937 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:51.556327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e459b-3b1b-485d-b6e3-67a475c22c60 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:51.560393 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8c3ee-a404-46c2-a096-99eab1566cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:51.561041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8c3ee-a404-46c2-a096-99eab1566cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:51.561320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8c3ee-a404-46c2-a096-99eab1566cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:51.561590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8c3ee-a404-46c2-a096-99eab1566cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:51.571927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8c3ee-a404-46c2-a096-99eab1566cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:51.573380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8c3ee-a404-46c2-a096-99eab1566cd6 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:51.583678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1346/2689] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:51.862243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40499d00-3b5c-4c53-b228-5dab7231559f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:51.863832 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-40499d00-3b5c-4c53-b228-5dab7231559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:51.877042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40499d00-3b5c-4c53-b228-5dab7231559f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:51.882205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:51.883205 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:51.883674 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:51.883983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] PATH_INFO: `/v3/projects/aaf006defbf54f99b3da3737618c53f7` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:51.885296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf006defbf54f99b3da3737618c53f7)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:51.887294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:51.928858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:51.938563 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf006defbf54f99b3da3737618c53f7', 'request_id': 'req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:51.943930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf006defbf54f99b3da3737618c53f7', 'request_id': 'req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:51.950137 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf006defbf54f99b3da3737618c53f7', 'request_id': 'req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:51.964232 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] The token cache is being invalidate because project aaf006defbf54f99b3da3737618c53f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:39:51.964529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:51.965531 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:51.967181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1344/2690] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:39:51 2022] DELETE /identity/v3/projects/aaf006defbf54f99b3da3737618c53f7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:51.971321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8c3ee-a404-46c2-a096-99eab1566cd6 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:51.981885 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8c3ee-a404-46c2-a096-99eab1566cd6 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:52.047794 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:52.048944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:52.049292 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:52.049707 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] PATH_INFO: `/v3/users/b0bf704ca07d47729dcb7c573d3c4dbc` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:52.051590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0bf704ca07d47729dcb7c573d3c4dbc)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:52.054741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:52.109306 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0bf704ca07d47729dcb7c573d3c4dbc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:52.109983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0bf704ca07d47729dcb7c573d3c4dbc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:52.120986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:52.122727 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0bf704ca07d47729dcb7c573d3c4dbc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:52.123554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0bf704ca07d47729dcb7c573d3c4dbc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:52.132106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2d115ee4-4c75-4ca8-a80f-e69936339ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0bf704ca07d47729dcb7c573d3c4dbc'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:52.146584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1347/2691] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:39:51 2022] DELETE /identity/v3/users/b0bf704ca07d47729dcb7c573d3c4dbc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:52.442151 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:52.443808 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:52.460476 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6b68d-57f4-47d9-8e1e-2ae5a04353f6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:52.526002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:52.526816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:52.527244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:52.527527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] PATH_INFO: `/v3/projects/5b31fd17d6154c99ad1644ab0aeaf6c2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:52.528905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b31fd17d6154c99ad1644ab0aeaf6c2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:52.530887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:52.594169 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b31fd17d6154c99ad1644ab0aeaf6c2', 'request_id': 'req-16e1fe1e-e088-431b-864e-6e42fd4ea21f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:52.601519 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b31fd17d6154c99ad1644ab0aeaf6c2', 'request_id': 'req-16e1fe1e-e088-431b-864e-6e42fd4ea21f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:52.608530 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b31fd17d6154c99ad1644ab0aeaf6c2', 'request_id': 'req-16e1fe1e-e088-431b-864e-6e42fd4ea21f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:52.627460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] The token cache is being invalidate because project 5b31fd17d6154c99ad1644ab0aeaf6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:39:52.627734 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:52.631132 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-16e1fe1e-e088-431b-864e-6e42fd4ea21f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:52.633118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1345/2692] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:39:52 2022] DELETE /identity/v3/projects/5b31fd17d6154c99ad1644ab0aeaf6c2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:52.638749 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73541dd-74be-4e5f-8212-56dc5fbb1862 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:52.639341 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73541dd-74be-4e5f-8212-56dc5fbb1862 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:52.639829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73541dd-74be-4e5f-8212-56dc5fbb1862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:52.659399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f73541dd-74be-4e5f-8212-56dc5fbb1862 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:52.660654 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f73541dd-74be-4e5f-8212-56dc5fbb1862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:52.723000 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1348/2693] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:52.730967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18934474-bf7e-45c1-bd4c-2fcd694c5113 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:52.731323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18934474-bf7e-45c1-bd4c-2fcd694c5113 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:52.731741 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18934474-bf7e-45c1-bd4c-2fcd694c5113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:52.750612 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-18934474-bf7e-45c1-bd4c-2fcd694c5113 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:52.751812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-18934474-bf7e-45c1-bd4c-2fcd694c5113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:52.759841 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1346/2694] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:39:52.764304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73541dd-74be-4e5f-8212-56dc5fbb1862 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:52.774022 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73541dd-74be-4e5f-8212-56dc5fbb1862 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:52.778981 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3fff-afb6-42b3-a04f-e1be8e97e2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:52.779579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3fff-afb6-42b3-a04f-e1be8e97e2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:52.779875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3fff-afb6-42b3-a04f-e1be8e97e2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:52.780168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3fff-afb6-42b3-a04f-e1be8e97e2f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:52.780907 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c3fff-afb6-42b3-a04f-e1be8e97e2f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:39:52.781216 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c3fff-afb6-42b3-a04f-e1be8e97e2f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:52.782831 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c3fff-afb6-42b3-a04f-e1be8e97e2f0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:52.795963 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1349/2695] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:39:52.802498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18934474-bf7e-45c1-bd4c-2fcd694c5113 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:52.815547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18934474-bf7e-45c1-bd4c-2fcd694c5113 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:52.821781 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd68a0-359a-46a0-987f-905c725242c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:52.822448 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd68a0-359a-46a0-987f-905c725242c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:52.822732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd68a0-359a-46a0-987f-905c725242c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:52.823006 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd68a0-359a-46a0-987f-905c725242c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:52.823702 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd68a0-359a-46a0-987f-905c725242c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:52.826124 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd68a0-359a-46a0-987f-905c725242c2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:52.855308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1347/2696] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:39:52 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:52.861294 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3fff-afb6-42b3-a04f-e1be8e97e2f0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:52.872436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3fff-afb6-42b3-a04f-e1be8e97e2f0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:52.933262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd35b-eb1d-466a-88ee-be83c1451103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:52.933978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd35b-eb1d-466a-88ee-be83c1451103 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:52.934260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd35b-eb1d-466a-88ee-be83c1451103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:52.934540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd35b-eb1d-466a-88ee-be83c1451103 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:52.935234 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cd35b-eb1d-466a-88ee-be83c1451103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:52.937202 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cd35b-eb1d-466a-88ee-be83c1451103 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:52.959369 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1350/2697] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:39:52 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:52.963803 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd68a0-359a-46a0-987f-905c725242c2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:52.974486 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd68a0-359a-46a0-987f-905c725242c2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:52.979957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4fac-a540-4cec-8f6c-30c4a3e13322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:52.981237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4fac-a540-4cec-8f6c-30c4a3e13322 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:52.981518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4fac-a540-4cec-8f6c-30c4a3e13322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:52.981796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4fac-a540-4cec-8f6c-30c4a3e13322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:52.982537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4fac-a540-4cec-8f6c-30c4a3e13322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:52.984184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4fac-a540-4cec-8f6c-30c4a3e13322 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:52.994913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1348/2698] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:52.999065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd35b-eb1d-466a-88ee-be83c1451103 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:53.009959 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd35b-eb1d-466a-88ee-be83c1451103 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:53.015828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c75075-ade7-43be-b2ef-7457a6880b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:53.016505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75075-ade7-43be-b2ef-7457a6880b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.016798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75075-ade7-43be-b2ef-7457a6880b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.017103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75075-ade7-43be-b2ef-7457a6880b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.017829 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c75075-ade7-43be-b2ef-7457a6880b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:53.019438 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c75075-ade7-43be-b2ef-7457a6880b68 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:53.030157 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1351/2699] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:53.036091 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4fac-a540-4cec-8f6c-30c4a3e13322 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:53.046460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4fac-a540-4cec-8f6c-30c4a3e13322 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:53.051459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146584-f087-43a1-b31d-95c88be3fa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:53.052376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146584-f087-43a1-b31d-95c88be3fa03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.052660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146584-f087-43a1-b31d-95c88be3fa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.053042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146584-f087-43a1-b31d-95c88be3fa03 admin admin] PATH_INFO: `/v3/projects/7255983bd3d741c0943dbb8270ae65a0/users/77fdb6f576044d9c89d708f584ff4de6/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.065245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:53.069036 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0146584-f087-43a1-b31d-95c88be3fa03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7255983bd3d741c0943dbb8270ae65a0, user_id=77fdb6f576044d9c89d708f584ff4de6, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:53.072583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0146584-f087-43a1-b31d-95c88be3fa03 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:53.090555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1349/2700] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:53 2022] PUT /identity/v3/projects/7255983bd3d741c0943dbb8270ae65a0/users/77fdb6f576044d9c89d708f584ff4de6/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:53.100927 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dff56-1674-4fac-9215-67e3dd207590 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.101290 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dff56-1674-4fac-9215-67e3dd207590 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.101472 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dff56-1674-4fac-9215-67e3dd207590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.128553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a42dff56-1674-4fac-9215-67e3dd207590 None None] MFA Rules not processed for user `77fdb6f576044d9c89d708f584ff4de6`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:53.129770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a42dff56-1674-4fac-9215-67e3dd207590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:53.174155 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:53.207969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1352/2701] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:53.212631 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146584-f087-43a1-b31d-95c88be3fa03 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:53.277296 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146584-f087-43a1-b31d-95c88be3fa03 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:53.282994 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d629d4-a6c8-4caa-81a1-f368fd772526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:53.283642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d629d4-a6c8-4caa-81a1-f368fd772526 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.284353 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d629d4-a6c8-4caa-81a1-f368fd772526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.284705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d629d4-a6c8-4caa-81a1-f368fd772526 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.285401 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d629d4-a6c8-4caa-81a1-f368fd772526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:53.287347 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d629d4-a6c8-4caa-81a1-f368fd772526 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:53.318859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1350/2702] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:39:53 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:53.323118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dff56-1674-4fac-9215-67e3dd207590 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:53.334094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dff56-1674-4fac-9215-67e3dd207590 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:53.392933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beffb2-289b-4883-92c9-0256649ff288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:53.393966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beffb2-289b-4883-92c9-0256649ff288 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.394413 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beffb2-289b-4883-92c9-0256649ff288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.394864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beffb2-289b-4883-92c9-0256649ff288 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.395948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beffb2-289b-4883-92c9-0256649ff288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:53.399032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beffb2-289b-4883-92c9-0256649ff288 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:53.422636 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1353/2703] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:39:53 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:53.426773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d629d4-a6c8-4caa-81a1-f368fd772526 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:53.437704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d629d4-a6c8-4caa-81a1-f368fd772526 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:53.443706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4b0a4-ed58-4645-b9e6-f72efb37fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:53.444417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4b0a4-ed58-4645-b9e6-f72efb37fb07 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.444701 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4b0a4-ed58-4645-b9e6-f72efb37fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.444959 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4b0a4-ed58-4645-b9e6-f72efb37fb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.445695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4b0a4-ed58-4645-b9e6-f72efb37fb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:53.447324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4b0a4-ed58-4645-b9e6-f72efb37fb07 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:53.458671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1351/2704] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:53.462875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beffb2-289b-4883-92c9-0256649ff288 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:53.473399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beffb2-289b-4883-92c9-0256649ff288 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:53.479284 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96618d2-0df7-4df1-a1e3-7e8e8fe08cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:53.480206 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96618d2-0df7-4df1-a1e3-7e8e8fe08cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.480488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96618d2-0df7-4df1-a1e3-7e8e8fe08cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.480756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96618d2-0df7-4df1-a1e3-7e8e8fe08cb8 admin admin] PATH_INFO: `/v3/projects/784cfcb3e6564d44a8f273a254c162bb/users/adcad5e45f2840a5adc4b971e96787fd/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.498103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96618d2-0df7-4df1-a1e3-7e8e8fe08cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784cfcb3e6564d44a8f273a254c162bb, user_id=adcad5e45f2840a5adc4b971e96787fd, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:53.500883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96618d2-0df7-4df1-a1e3-7e8e8fe08cb8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:53.515548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1354/2705] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:53 2022] PUT /identity/v3/projects/784cfcb3e6564d44a8f273a254c162bb/users/adcad5e45f2840a5adc4b971e96787fd/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:53.519630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4b0a4-ed58-4645-b9e6-f72efb37fb07 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:53.530172 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4b0a4-ed58-4645-b9e6-f72efb37fb07 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:53.590035 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3643a22-60c0-460f-9c5d-48e7c389c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:53.590700 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643a22-60c0-460f-9c5d-48e7c389c6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.590996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643a22-60c0-460f-9c5d-48e7c389c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.591259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3643a22-60c0-460f-9c5d-48e7c389c6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.592018 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3643a22-60c0-460f-9c5d-48e7c389c6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:53.593667 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3643a22-60c0-460f-9c5d-48e7c389c6e6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:53.603413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1352/2706] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:53.607994 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96618d2-0df7-4df1-a1e3-7e8e8fe08cb8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:53.618498 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96618d2-0df7-4df1-a1e3-7e8e8fe08cb8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:53.624292 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9df8d6-a688-455b-b319-4cb61545ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:53.625175 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9df8d6-a688-455b-b319-4cb61545ea1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.625459 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9df8d6-a688-455b-b319-4cb61545ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.625734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9df8d6-a688-455b-b319-4cb61545ea1c admin admin] PATH_INFO: `/v3/projects/784cfcb3e6564d44a8f273a254c162bb/users/adcad5e45f2840a5adc4b971e96787fd/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.627724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9df8d6-a688-455b-b319-4cb61545ea1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=784cfcb3e6564d44a8f273a254c162bb, user_id=adcad5e45f2840a5adc4b971e96787fd, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:53.630383 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9df8d6-a688-455b-b319-4cb61545ea1c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:53.641842 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1355/2707] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:53 2022] PUT /identity/v3/projects/784cfcb3e6564d44a8f273a254c162bb/users/adcad5e45f2840a5adc4b971e96787fd/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:53.660179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412086e6-ee5c-4a8c-b588-6d2459786dfa None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.660554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412086e6-ee5c-4a8c-b588-6d2459786dfa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.660934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412086e6-ee5c-4a8c-b588-6d2459786dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.689680 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-412086e6-ee5c-4a8c-b588-6d2459786dfa None None] MFA Rules not processed for user `adcad5e45f2840a5adc4b971e96787fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:53.690894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-412086e6-ee5c-4a8c-b588-6d2459786dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:53.742776 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:53.767759 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1353/2708] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:53.780397 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9df8d6-a688-455b-b319-4cb61545ea1c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:53.782348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da9df8d6-a688-455b-b319-4cb61545ea1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:53.841656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9df8d6-a688-455b-b319-4cb61545ea1c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:53.845938 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92de0d-3ece-4dfc-9169-5a5394ecb3ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:53.846662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92de0d-3ece-4dfc-9169-5a5394ecb3ca service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:53.846978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92de0d-3ece-4dfc-9169-5a5394ecb3ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:53.847295 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92de0d-3ece-4dfc-9169-5a5394ecb3ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:53.857365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92de0d-3ece-4dfc-9169-5a5394ecb3ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:53.858828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92de0d-3ece-4dfc-9169-5a5394ecb3ca service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:53.868756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1356/2709] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:54.200383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412086e6-ee5c-4a8c-b588-6d2459786dfa None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:54.209993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412086e6-ee5c-4a8c-b588-6d2459786dfa None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:54.215505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd93bb-6875-4719-ab22-01f2907dee51 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcad5e45f2840a5adc4b971e96787fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784cfcb3e6564d44a8f273a254c162bb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:54.216371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd93bb-6875-4719-ab22-01f2907dee51 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:54.216661 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd93bb-6875-4719-ab22-01f2907dee51 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:54.216939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd93bb-6875-4719-ab22-01f2907dee51 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:54.217690 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd93bb-6875-4719-ab22-01f2907dee51 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:39:54.218002 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd93bb-6875-4719-ab22-01f2907dee51 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:54.219638 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd93bb-6875-4719-ab22-01f2907dee51 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:54.231998 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1354/2710] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:39:54.236617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92de0d-3ece-4dfc-9169-5a5394ecb3ca service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:54.246864 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92de0d-3ece-4dfc-9169-5a5394ecb3ca service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:54.253541 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e77a-cbc8-4481-9871-c4f1f03cd27c tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcad5e45f2840a5adc4b971e96787fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784cfcb3e6564d44a8f273a254c162bb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:54.254211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e77a-cbc8-4481-9871-c4f1f03cd27c tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:54.254491 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e77a-cbc8-4481-9871-c4f1f03cd27c tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:54.254765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e77a-cbc8-4481-9871-c4f1f03cd27c tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:54.255467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379e77a-cbc8-4481-9871-c4f1f03cd27c tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:54.257418 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379e77a-cbc8-4481-9871-c4f1f03cd27c tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:54.292417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1357/2711] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:39:54 2022] POST /identity/v3/projects => generated 354 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:54.297308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd93bb-6875-4719-ab22-01f2907dee51 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:54.308245 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd93bb-6875-4719-ab22-01f2907dee51 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:54.368183 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99d879-a6a7-4cae-bebc-10ef2bfa0bc3 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcad5e45f2840a5adc4b971e96787fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784cfcb3e6564d44a8f273a254c162bb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:54.368868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99d879-a6a7-4cae-bebc-10ef2bfa0bc3 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:54.369186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99d879-a6a7-4cae-bebc-10ef2bfa0bc3 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:54.369495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99d879-a6a7-4cae-bebc-10ef2bfa0bc3 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:54.370243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99d879-a6a7-4cae-bebc-10ef2bfa0bc3 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:39:54.370587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99d879-a6a7-4cae-bebc-10ef2bfa0bc3 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:54.372367 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99d879-a6a7-4cae-bebc-10ef2bfa0bc3 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:54.386114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1355/2712] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:39:54.425917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e77a-cbc8-4481-9871-c4f1f03cd27c tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:54.442284 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e77a-cbc8-4481-9871-c4f1f03cd27c tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:54.450037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcad5e45f2840a5adc4b971e96787fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '784cfcb3e6564d44a8f273a254c162bb', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:54.451072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:54.451356 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:54.451631 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] PATH_INFO: `/v3/projects/b7fefe72ad6d43b59d0cc6c43cbb342e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:54.453045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7fefe72ad6d43b59d0cc6c43cbb342e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:54.454952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:54.457391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:54.507416 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fefe72ad6d43b59d0cc6c43cbb342e', 'request_id': 'req-9a43b56f-8917-4e0b-8972-65646e6ac948'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:54.516324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fefe72ad6d43b59d0cc6c43cbb342e', 'request_id': 'req-9a43b56f-8917-4e0b-8972-65646e6ac948'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:54.523182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fefe72ad6d43b59d0cc6c43cbb342e', 'request_id': 'req-9a43b56f-8917-4e0b-8972-65646e6ac948'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:54.533293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] The token cache is being invalidate because project b7fefe72ad6d43b59d0cc6c43cbb342e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:39:54.533574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:54.534551 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9a43b56f-8917-4e0b-8972-65646e6ac948 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:54.536109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1358/2713] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:39:54 2022] DELETE /identity/v3/projects/b7fefe72ad6d43b59d0cc6c43cbb342e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:54.742868 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99d879-a6a7-4cae-bebc-10ef2bfa0bc3 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:54.744726 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7a99d879-a6a7-4cae-bebc-10ef2bfa0bc3 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:54.816508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99d879-a6a7-4cae-bebc-10ef2bfa0bc3 tempest-VolumeQuotaClassesTest-887616260 tempest-VolumeQuotaClassesTest-887616260-project-admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:54.875796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:54.877135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:54.877555 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:54.877895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] PATH_INFO: `/v3/users/77fdb6f576044d9c89d708f584ff4de6` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:54.879953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fdb6f576044d9c89d708f584ff4de6)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:54.882992 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:54.906492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:54.942287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fdb6f576044d9c89d708f584ff4de6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:54.954580 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fdb6f576044d9c89d708f584ff4de6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:54.964131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fdb6f576044d9c89d708f584ff4de6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:54.971285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fdb6f576044d9c89d708f584ff4de6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:54.971940 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fdb6f576044d9c89d708f584ff4de6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:54.978481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1356/2714] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:39:54 2022] DELETE /identity/v3/users/77fdb6f576044d9c89d708f584ff4de6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:54.983494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c5cf-bdd3-4720-99c1-1e82d3a11772 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:54.983980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c5cf-bdd3-4720-99c1-1e82d3a11772 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:54.984188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549c5cf-bdd3-4720-99c1-1e82d3a11772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:55.003635 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0549c5cf-bdd3-4720-99c1-1e82d3a11772 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:55.004952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0549c5cf-bdd3-4720-99c1-1e82d3a11772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:55.066260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1359/2715] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:55.075558 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:55.077023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:55.133899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd66ec-33c5-4448-87a1-712bfd9aed38 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:55.138020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73784b-119a-4203-87d4-a3434e5139dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:55.138666 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73784b-119a-4203-87d4-a3434e5139dc service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:55.138947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73784b-119a-4203-87d4-a3434e5139dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:55.139231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73784b-119a-4203-87d4-a3434e5139dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:55.149216 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73784b-119a-4203-87d4-a3434e5139dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:55.150731 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73784b-119a-4203-87d4-a3434e5139dc service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:55.160414 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1357/2716] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:55.448926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549c5cf-bdd3-4720-99c1-1e82d3a11772 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:55.450440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0549c5cf-bdd3-4720-99c1-1e82d3a11772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:55.463530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549c5cf-bdd3-4720-99c1-1e82d3a11772 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:55.468238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:55.469143 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:55.469421 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:55.469702 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] PATH_INFO: `/v3/projects/7255983bd3d741c0943dbb8270ae65a0` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:55.471518 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7255983bd3d741c0943dbb8270ae65a0)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:55.473673 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:55.520906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7255983bd3d741c0943dbb8270ae65a0', 'request_id': 'req-5a1c430f-c256-401d-82cc-f59ce9f39410'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:55.530454 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7255983bd3d741c0943dbb8270ae65a0', 'request_id': 'req-5a1c430f-c256-401d-82cc-f59ce9f39410'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:55.537568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7255983bd3d741c0943dbb8270ae65a0', 'request_id': 'req-5a1c430f-c256-401d-82cc-f59ce9f39410'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:55.548676 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] The token cache is being invalidate because project 7255983bd3d741c0943dbb8270ae65a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:39:55.548966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:55.549624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:55.551208 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1360/2717] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:39:55 2022] DELETE /identity/v3/projects/7255983bd3d741c0943dbb8270ae65a0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:55.555323 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73784b-119a-4203-87d4-a3434e5139dc service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:55.566705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73784b-119a-4203-87d4-a3434e5139dc service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:55.628969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:55.629880 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:55.630167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:55.630446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] PATH_INFO: `/v3/users/adcad5e45f2840a5adc4b971e96787fd` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:55.631689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adcad5e45f2840a5adc4b971e96787fd)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:55.633693 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:55.677157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:55.684412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adcad5e45f2840a5adc4b971e96787fd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:55.697241 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adcad5e45f2840a5adc4b971e96787fd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:55.706153 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adcad5e45f2840a5adc4b971e96787fd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:55.713710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adcad5e45f2840a5adc4b971e96787fd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:55.714514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2050ca7-e17a-42de-b921-7e9be8876360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adcad5e45f2840a5adc4b971e96787fd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:55.720991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1358/2718] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:39:55 2022] DELETE /identity/v3/users/adcad5e45f2840a5adc4b971e96787fd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:56.007249 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.009681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:56.024581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c430f-c256-401d-82cc-f59ce9f39410 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.038502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:56.086610 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.087479 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.087760 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.088070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] PATH_INFO: `/v3/projects/784cfcb3e6564d44a8f273a254c162bb` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.089327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784cfcb3e6564d44a8f273a254c162bb)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:56.091246 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:56.140657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784cfcb3e6564d44a8f273a254c162bb', 'request_id': 'req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:56.149932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784cfcb3e6564d44a8f273a254c162bb', 'request_id': 'req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:56.157706 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784cfcb3e6564d44a8f273a254c162bb', 'request_id': 'req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:56.168425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] The token cache is being invalidate because project 784cfcb3e6564d44a8f273a254c162bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:39:56.168719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:56.169373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c3eb2c65-50ff-4e42-8611-a6321b4a07f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:39:56.171230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1361/2719] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:39:56 2022] DELETE /identity/v3/projects/784cfcb3e6564d44a8f273a254c162bb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:56.176484 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc201b6-b28a-47be-b751-fc879718c9f6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.177011 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc201b6-b28a-47be-b751-fc879718c9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.177136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc201b6-b28a-47be-b751-fc879718c9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.197953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bdc201b6-b28a-47be-b751-fc879718c9f6 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:56.199287 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bdc201b6-b28a-47be-b751-fc879718c9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:56.263498 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1359/2720] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:56.271174 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae2031-5d6d-4a73-a7f2-fed78c612900 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.271425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae2031-5d6d-4a73-a7f2-fed78c612900 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.271697 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae2031-5d6d-4a73-a7f2-fed78c612900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.290520 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-90ae2031-5d6d-4a73-a7f2-fed78c612900 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:56.291733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-90ae2031-5d6d-4a73-a7f2-fed78c612900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:56.300087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1362/2721] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:56.304544 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc201b6-b28a-47be-b751-fc879718c9f6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.314625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc201b6-b28a-47be-b751-fc879718c9f6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.319370 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a75ca-18c8-4d05-b492-aff7e5ffdde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.320050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a75ca-18c8-4d05-b492-aff7e5ffdde4 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.320337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a75ca-18c8-4d05-b492-aff7e5ffdde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.320634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a75ca-18c8-4d05-b492-aff7e5ffdde4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.321366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a75ca-18c8-4d05-b492-aff7e5ffdde4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:39:56.321672 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a75ca-18c8-4d05-b492-aff7e5ffdde4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:56.323302 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a75ca-18c8-4d05-b492-aff7e5ffdde4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:56.335005 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1360/2722] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:39:56.339327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae2031-5d6d-4a73-a7f2-fed78c612900 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.349164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae2031-5d6d-4a73-a7f2-fed78c612900 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.354889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a92a9-13a3-4729-89aa-8bda5e30051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.355569 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a92a9-13a3-4729-89aa-8bda5e30051b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.355852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a92a9-13a3-4729-89aa-8bda5e30051b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.356156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a92a9-13a3-4729-89aa-8bda5e30051b admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.356859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a92a9-13a3-4729-89aa-8bda5e30051b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:56.358768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a92a9-13a3-4729-89aa-8bda5e30051b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:56.388801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1363/2723] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:39:56 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:56.393288 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a75ca-18c8-4d05-b492-aff7e5ffdde4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.403947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a75ca-18c8-4d05-b492-aff7e5ffdde4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.460393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423de9cd-3996-4710-a4b4-1106e48b320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.461346 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423de9cd-3996-4710-a4b4-1106e48b320e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.461624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423de9cd-3996-4710-a4b4-1106e48b320e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.461892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423de9cd-3996-4710-a4b4-1106e48b320e admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.462774 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423de9cd-3996-4710-a4b4-1106e48b320e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:56.465265 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423de9cd-3996-4710-a4b4-1106e48b320e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:56.488780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1361/2724] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:39:56 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:56.492972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a92a9-13a3-4729-89aa-8bda5e30051b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.504436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a92a9-13a3-4729-89aa-8bda5e30051b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.510257 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4f84-1038-493b-a23e-c57e8bbaf5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.510952 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4f84-1038-493b-a23e-c57e8bbaf5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.511231 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4f84-1038-493b-a23e-c57e8bbaf5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.511545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4f84-1038-493b-a23e-c57e8bbaf5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.512353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d4f84-1038-493b-a23e-c57e8bbaf5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:56.514007 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d4f84-1038-493b-a23e-c57e8bbaf5a1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:56.524861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1364/2725] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:56.528905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423de9cd-3996-4710-a4b4-1106e48b320e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.539748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423de9cd-3996-4710-a4b4-1106e48b320e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.544775 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10d0aa-32c5-401b-87fd-97c61145c77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.545478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10d0aa-32c5-401b-87fd-97c61145c77b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.545786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10d0aa-32c5-401b-87fd-97c61145c77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.546168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10d0aa-32c5-401b-87fd-97c61145c77b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.546909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10d0aa-32c5-401b-87fd-97c61145c77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:56.548549 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10d0aa-32c5-401b-87fd-97c61145c77b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:56.558599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1362/2726] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:56.562884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4f84-1038-493b-a23e-c57e8bbaf5a1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.573152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4f84-1038-493b-a23e-c57e8bbaf5a1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.580259 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215a02d-7925-4e24-9b7f-905812c03e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.581483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215a02d-7925-4e24-9b7f-905812c03e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.581847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215a02d-7925-4e24-9b7f-905812c03e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.582209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215a02d-7925-4e24-9b7f-905812c03e15 admin admin] PATH_INFO: `/v3/projects/77a55fbdcc684ea58bbeeb51180c4737/users/d7889c36e7794ed89521f406eccb4c77/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.598779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215a02d-7925-4e24-9b7f-905812c03e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a55fbdcc684ea58bbeeb51180c4737, user_id=d7889c36e7794ed89521f406eccb4c77, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:56.601430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215a02d-7925-4e24-9b7f-905812c03e15 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:56.616563 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1365/2727] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:56 2022] PUT /identity/v3/projects/77a55fbdcc684ea58bbeeb51180c4737/users/d7889c36e7794ed89521f406eccb4c77/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:56.627122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb2501-7c5b-48ad-a31a-1c018b1c3701 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.627399 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb2501-7c5b-48ad-a31a-1c018b1c3701 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.627671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb2501-7c5b-48ad-a31a-1c018b1c3701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.654179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d2bb2501-7c5b-48ad-a31a-1c018b1c3701 None None] MFA Rules not processed for user `d7889c36e7794ed89521f406eccb4c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:56.655917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d2bb2501-7c5b-48ad-a31a-1c018b1c3701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:56.665740 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:56.723403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1363/2728] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:56.728053 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215a02d-7925-4e24-9b7f-905812c03e15 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.776304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:56.796944 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215a02d-7925-4e24-9b7f-905812c03e15 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.801695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e383d6-c654-4429-ba6e-aa099cd1fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.802364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e383d6-c654-4429-ba6e-aa099cd1fb31 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.802644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e383d6-c654-4429-ba6e-aa099cd1fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.802922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e383d6-c654-4429-ba6e-aa099cd1fb31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.803626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e383d6-c654-4429-ba6e-aa099cd1fb31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:56.805574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e383d6-c654-4429-ba6e-aa099cd1fb31 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:56.832426 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1366/2729] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:39:56 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:56.836542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb2501-7c5b-48ad-a31a-1c018b1c3701 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.848337 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb2501-7c5b-48ad-a31a-1c018b1c3701 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.905794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168da72-7822-4f15-bca8-c8a4ebec69af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.906489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168da72-7822-4f15-bca8-c8a4ebec69af admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.906754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168da72-7822-4f15-bca8-c8a4ebec69af admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.907038 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168da72-7822-4f15-bca8-c8a4ebec69af admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.907733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168da72-7822-4f15-bca8-c8a4ebec69af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:56.910056 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168da72-7822-4f15-bca8-c8a4ebec69af admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:56.931887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1364/2730] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:39:56 2022] POST /identity/v3/users => generated 307 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:39:56.937910 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e383d6-c654-4429-ba6e-aa099cd1fb31 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.948668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e383d6-c654-4429-ba6e-aa099cd1fb31 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.953845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cdacc-5c25-4d56-baa9-dc7b95debddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.954729 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cdacc-5c25-4d56-baa9-dc7b95debddb admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.955014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cdacc-5c25-4d56-baa9-dc7b95debddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.955284 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cdacc-5c25-4d56-baa9-dc7b95debddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:56.956024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cdacc-5c25-4d56-baa9-dc7b95debddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:56.957623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cdacc-5c25-4d56-baa9-dc7b95debddb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:56.968762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1367/2731] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:56.972848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168da72-7822-4f15-bca8-c8a4ebec69af admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:56.983343 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168da72-7822-4f15-bca8-c8a4ebec69af admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:56.988093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29592b7-efe9-4dd2-a409-1ecfb992e1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:56.988980 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29592b7-efe9-4dd2-a409-1ecfb992e1c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:56.989259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29592b7-efe9-4dd2-a409-1ecfb992e1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:56.989532 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29592b7-efe9-4dd2-a409-1ecfb992e1c1 admin admin] PATH_INFO: `/v3/projects/0cb0f6b99b524ab7a77e3a777ea0c8fa/users/243ebcc5baa845b784a9817479736f1d/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:57.005140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29592b7-efe9-4dd2-a409-1ecfb992e1c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb0f6b99b524ab7a77e3a777ea0c8fa, user_id=243ebcc5baa845b784a9817479736f1d, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:57.007867 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29592b7-efe9-4dd2-a409-1ecfb992e1c1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:57.022191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1365/2732] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:56 2022] PUT /identity/v3/projects/0cb0f6b99b524ab7a77e3a777ea0c8fa/users/243ebcc5baa845b784a9817479736f1d/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:57.026285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cdacc-5c25-4d56-baa9-dc7b95debddb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:57.040059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cdacc-5c25-4d56-baa9-dc7b95debddb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:57.103595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463be885-ddf7-4b91-b752-76d35d8bdd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:57.104288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be885-ddf7-4b91-b752-76d35d8bdd8b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:57.104592 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be885-ddf7-4b91-b752-76d35d8bdd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:57.104846 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be885-ddf7-4b91-b752-76d35d8bdd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:57.105579 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463be885-ddf7-4b91-b752-76d35d8bdd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:57.107194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463be885-ddf7-4b91-b752-76d35d8bdd8b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:57.117440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1368/2733] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:39:57.121732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29592b7-efe9-4dd2-a409-1ecfb992e1c1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:57.132834 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29592b7-efe9-4dd2-a409-1ecfb992e1c1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:57.137999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5a0ea-02ab-4728-9ea5-109f5486b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:57.138894 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a0ea-02ab-4728-9ea5-109f5486b53c admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:57.139417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a0ea-02ab-4728-9ea5-109f5486b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:57.139798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a0ea-02ab-4728-9ea5-109f5486b53c admin admin] PATH_INFO: `/v3/projects/0cb0f6b99b524ab7a77e3a777ea0c8fa/users/243ebcc5baa845b784a9817479736f1d/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:57.141830 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5a0ea-02ab-4728-9ea5-109f5486b53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb0f6b99b524ab7a77e3a777ea0c8fa, user_id=243ebcc5baa845b784a9817479736f1d, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:57.144609 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5a0ea-02ab-4728-9ea5-109f5486b53c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:57.155605 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1366/2734] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:39:57 2022] PUT /identity/v3/projects/0cb0f6b99b524ab7a77e3a777ea0c8fa/users/243ebcc5baa845b784a9817479736f1d/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:39:57.167211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276aab-d9ca-4138-ae14-739a68feb87b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:57.167503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276aab-d9ca-4138-ae14-739a68feb87b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:57.167777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276aab-d9ca-4138-ae14-739a68feb87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:57.196500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-06276aab-d9ca-4138-ae14-739a68feb87b None None] MFA Rules not processed for user `243ebcc5baa845b784a9817479736f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:39:57.198322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-06276aab-d9ca-4138-ae14-739a68feb87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:57.281307 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1369/2735] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:39:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:39:57.292103 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5a0ea-02ab-4728-9ea5-109f5486b53c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:57.298481 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-22d5a0ea-02ab-4728-9ea5-109f5486b53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:39:57.363697 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5a0ea-02ab-4728-9ea5-109f5486b53c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:57.368231 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56762e-d52a-4541-a7a5-92aed158bb81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:57.368924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56762e-d52a-4541-a7a5-92aed158bb81 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:57.369324 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56762e-d52a-4541-a7a5-92aed158bb81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:57.369696 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56762e-d52a-4541-a7a5-92aed158bb81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:57.381493 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56762e-d52a-4541-a7a5-92aed158bb81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:57.383442 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56762e-d52a-4541-a7a5-92aed158bb81 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:57.396752 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1367/2736] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:57 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:39:57.480037 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276aab-d9ca-4138-ae14-739a68feb87b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:39:57.491028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276aab-d9ca-4138-ae14-739a68feb87b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:39:57.494899 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fb3c7-cf9a-4435-a04a-c02f0e223650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:39:57.495621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fb3c7-cf9a-4435-a04a-c02f0e223650 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:39:57.495949 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fb3c7-cf9a-4435-a04a-c02f0e223650 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:39:57.496265 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fb3c7-cf9a-4435-a04a-c02f0e223650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:39:57.532997 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:39:57.559035 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fb3c7-cf9a-4435-a04a-c02f0e223650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:39:57.560431 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fb3c7-cf9a-4435-a04a-c02f0e223650 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:39:57.571757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1370/2737] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:39:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:00.042965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56762e-d52a-4541-a7a5-92aed158bb81 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:00.044568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1e56762e-d52a-4541-a7a5-92aed158bb81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:00.055515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:00.103718 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56762e-d52a-4541-a7a5-92aed158bb81 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:00.107599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5ebfd-9f76-4f73-b44a-550dda825aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:00.108281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ebfd-9f76-4f73-b44a-550dda825aff service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:00.108565 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ebfd-9f76-4f73-b44a-550dda825aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:00.108848 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ebfd-9f76-4f73-b44a-550dda825aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:00.111277 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bda5ebfd-9f76-4f73-b44a-550dda825aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:00.182630 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5ebfd-9f76-4f73-b44a-550dda825aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:00.184116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5ebfd-9f76-4f73-b44a-550dda825aff service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:00.194173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1368/2738] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:01.709492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fb3c7-cf9a-4435-a04a-c02f0e223650 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:01.778810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fb3c7-cf9a-4435-a04a-c02f0e223650 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:01.783686 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:01.784942 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:01.785227 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:01.785500 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] PATH_INFO: `/v3/users/d7889c36e7794ed89521f406eccb4c77` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:01.786734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7889c36e7794ed89521f406eccb4c77)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:01.788736 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:01.837906 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7889c36e7794ed89521f406eccb4c77'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:01.838537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7889c36e7794ed89521f406eccb4c77'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:01.850355 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7889c36e7794ed89521f406eccb4c77'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:01.851029 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7889c36e7794ed89521f406eccb4c77'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:01.858245 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7889c36e7794ed89521f406eccb4c77'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:01.873761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1371/2739] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:40:01 2022] DELETE /identity/v3/users/d7889c36e7794ed89521f406eccb4c77 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:01.880644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3afa5-8cb1-4508-8be3-8965bbeea976 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:01.881185 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3afa5-8cb1-4508-8be3-8965bbeea976 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:01.881294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3afa5-8cb1-4508-8be3-8965bbeea976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:01.898844 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-24e3afa5-8cb1-4508-8be3-8965bbeea976 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:01.900090 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-24e3afa5-8cb1-4508-8be3-8965bbeea976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:01.967114 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1369/2740] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:40:01.977034 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:01.978624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:02.040662 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190282ce-56f4-4451-b664-bc63bce09ded admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:02.044634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a1af-2c05-4e25-8a75-a3ed34db6b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:02.045444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a1af-2c05-4e25-8a75-a3ed34db6b84 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:02.045733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a1af-2c05-4e25-8a75-a3ed34db6b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:02.046004 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a1af-2c05-4e25-8a75-a3ed34db6b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:02.059506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0a1af-2c05-4e25-8a75-a3ed34db6b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:02.060989 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0a1af-2c05-4e25-8a75-a3ed34db6b84 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:02.065252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:02.074181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1372/2741] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 18:40:02.482158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3afa5-8cb1-4508-8be3-8965bbeea976 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:02.483800 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-24e3afa5-8cb1-4508-8be3-8965bbeea976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:02.497426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3afa5-8cb1-4508-8be3-8965bbeea976 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:02.515147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:02.517138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:02.517449 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:02.517684 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] PATH_INFO: `/v3/projects/77a55fbdcc684ea58bbeeb51180c4737` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:02.519010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a55fbdcc684ea58bbeeb51180c4737)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:02.520897 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:02.572797 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a55fbdcc684ea58bbeeb51180c4737', 'request_id': 'req-1a6463bf-0891-409d-a8db-3e037c3f5572'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:02.575139 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:02.581257 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a55fbdcc684ea58bbeeb51180c4737', 'request_id': 'req-1a6463bf-0891-409d-a8db-3e037c3f5572'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:02.588575 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a55fbdcc684ea58bbeeb51180c4737', 'request_id': 'req-1a6463bf-0891-409d-a8db-3e037c3f5572'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:02.603387 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] The token cache is being invalidate because project 77a55fbdcc684ea58bbeeb51180c4737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:40:02.603579 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:02.604283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:02.606136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1370/2742] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:40:02 2022] DELETE /identity/v3/projects/77a55fbdcc684ea58bbeeb51180c4737 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:02.610352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a1af-2c05-4e25-8a75-a3ed34db6b84 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:02.620284 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a1af-2c05-4e25-8a75-a3ed34db6b84 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:02.692858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:02.694190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:02.694190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:02.694429 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] PATH_INFO: `/v3/users/243ebcc5baa845b784a9817479736f1d` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:02.696038 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] RBAC: Authorizing `identity:delete_user(user_id=243ebcc5baa845b784a9817479736f1d)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:02.697753 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:02.757086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '243ebcc5baa845b784a9817479736f1d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:02.757724 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '243ebcc5baa845b784a9817479736f1d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:02.771738 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '243ebcc5baa845b784a9817479736f1d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:02.772984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '243ebcc5baa845b784a9817479736f1d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:02.781468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-00478a7c-e2a7-4869-953b-c471002b771a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '243ebcc5baa845b784a9817479736f1d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:02.796066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1373/2743] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:40:02 2022] DELETE /identity/v3/users/243ebcc5baa845b784a9817479736f1d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:40:03.089459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:03.091695 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:03.106135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6463bf-0891-409d-a8db-3e037c3f5572 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:03.171019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:03.172091 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.172395 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.172665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] PATH_INFO: `/v3/projects/0cb0f6b99b524ab7a77e3a777ea0c8fa` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.173865 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb0f6b99b524ab7a77e3a777ea0c8fa)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:03.175933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:03.229765 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb0f6b99b524ab7a77e3a777ea0c8fa', 'request_id': 'req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:03.235273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb0f6b99b524ab7a77e3a777ea0c8fa', 'request_id': 'req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:03.241467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb0f6b99b524ab7a77e3a777ea0c8fa', 'request_id': 'req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:03.255600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] The token cache is being invalidate because project 0cb0f6b99b524ab7a77e3a777ea0c8fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:40:03.255902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:03.256657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3b4a2d9-fb4f-43a6-8c75-73fbd6cd8caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:03.258283 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1371/2744] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:40:03 2022] DELETE /identity/v3/projects/0cb0f6b99b524ab7a77e3a777ea0c8fa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:03.263467 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8ebd5-4263-48ee-9e51-53605f2b78e1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.263779 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8ebd5-4263-48ee-9e51-53605f2b78e1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.264088 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8ebd5-4263-48ee-9e51-53605f2b78e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.283424 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b0d8ebd5-4263-48ee-9e51-53605f2b78e1 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:03.284998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b0d8ebd5-4263-48ee-9e51-53605f2b78e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:03.351550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1374/2745] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:03.360900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c99e5-31ba-4507-8b8f-6eb31c9658ef None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.361320 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c99e5-31ba-4507-8b8f-6eb31c9658ef None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.361671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c99e5-31ba-4507-8b8f-6eb31c9658ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.391728 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-599c99e5-31ba-4507-8b8f-6eb31c9658ef None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:03.392902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-599c99e5-31ba-4507-8b8f-6eb31c9658ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:03.402725 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1372/2746] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:03.407264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8ebd5-4263-48ee-9e51-53605f2b78e1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:03.418019 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8ebd5-4263-48ee-9e51-53605f2b78e1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:03.424281 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10bd1f-c3a8-49fd-90ae-7ec593336c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:03.425056 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10bd1f-c3a8-49fd-90ae-7ec593336c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.425343 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10bd1f-c3a8-49fd-90ae-7ec593336c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.425616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10bd1f-c3a8-49fd-90ae-7ec593336c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.426353 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10bd1f-c3a8-49fd-90ae-7ec593336c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:40:03.426666 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10bd1f-c3a8-49fd-90ae-7ec593336c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:03.428316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10bd1f-c3a8-49fd-90ae-7ec593336c40 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:03.440770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1375/2747] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 18:40:03.445322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c99e5-31ba-4507-8b8f-6eb31c9658ef None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:03.455252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c99e5-31ba-4507-8b8f-6eb31c9658ef None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:03.461106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b5b70-50c9-4fe6-a8bd-bde126b29104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:03.461785 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b5b70-50c9-4fe6-a8bd-bde126b29104 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.462062 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b5b70-50c9-4fe6-a8bd-bde126b29104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.462331 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b5b70-50c9-4fe6-a8bd-bde126b29104 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.463020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b5b70-50c9-4fe6-a8bd-bde126b29104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:03.464962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b5b70-50c9-4fe6-a8bd-bde126b29104 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:03.494899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1373/2748] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:40:03 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:40:03.500381 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10bd1f-c3a8-49fd-90ae-7ec593336c40 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:03.506998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:03.511111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10bd1f-c3a8-49fd-90ae-7ec593336c40 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:03.576447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b80fba-7c05-463f-bbd2-c9f9b33591bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:03.577118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b80fba-7c05-463f-bbd2-c9f9b33591bc admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.577399 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b80fba-7c05-463f-bbd2-c9f9b33591bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.577740 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b80fba-7c05-463f-bbd2-c9f9b33591bc admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.578954 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b80fba-7c05-463f-bbd2-c9f9b33591bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:03.580921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b80fba-7c05-463f-bbd2-c9f9b33591bc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:03.607325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1376/2749] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:40:03 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:40:03.611913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b5b70-50c9-4fe6-a8bd-bde126b29104 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:03.622482 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b5b70-50c9-4fe6-a8bd-bde126b29104 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:03.628300 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ec3ac-c9e5-43b8-a60b-76f0fb3c8367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:03.628965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ec3ac-c9e5-43b8-a60b-76f0fb3c8367 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.629248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ec3ac-c9e5-43b8-a60b-76f0fb3c8367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.629520 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ec3ac-c9e5-43b8-a60b-76f0fb3c8367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.630253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ec3ac-c9e5-43b8-a60b-76f0fb3c8367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:03.631876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ec3ac-c9e5-43b8-a60b-76f0fb3c8367 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:03.642851 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1374/2750] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:03.647176 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b80fba-7c05-463f-bbd2-c9f9b33591bc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:03.657923 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b80fba-7c05-463f-bbd2-c9f9b33591bc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:03.663367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0b31b-2463-45ee-85f9-cff1a0e463fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:03.664118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0b31b-2463-45ee-85f9-cff1a0e463fa admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.664303 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0b31b-2463-45ee-85f9-cff1a0e463fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.664601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0b31b-2463-45ee-85f9-cff1a0e463fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.665327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0b31b-2463-45ee-85f9-cff1a0e463fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:03.666934 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0b31b-2463-45ee-85f9-cff1a0e463fa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:03.677776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1377/2751] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:03.683155 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ec3ac-c9e5-43b8-a60b-76f0fb3c8367 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:03.693939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ec3ac-c9e5-43b8-a60b-76f0fb3c8367 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:03.699743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c062c6a-1a55-4f3c-ad60-ce2880f837a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:03.700673 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c062c6a-1a55-4f3c-ad60-ce2880f837a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.700951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c062c6a-1a55-4f3c-ad60-ce2880f837a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.701229 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c062c6a-1a55-4f3c-ad60-ce2880f837a5 admin admin] PATH_INFO: `/v3/projects/616f0e1fa400442484a6db461db88ccf/users/a0b2d650f7484354a7078846dec1f581/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.716858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c062c6a-1a55-4f3c-ad60-ce2880f837a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616f0e1fa400442484a6db461db88ccf, user_id=a0b2d650f7484354a7078846dec1f581, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:03.719782 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c062c6a-1a55-4f3c-ad60-ce2880f837a5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:03.737012 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1375/2752] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:40:03 2022] PUT /identity/v3/projects/616f0e1fa400442484a6db461db88ccf/users/a0b2d650f7484354a7078846dec1f581/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:03.748276 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8576-2227-472e-a26a-9ef4fe79bb92 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.748717 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8576-2227-472e-a26a-9ef4fe79bb92 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.749094 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8576-2227-472e-a26a-9ef4fe79bb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.775980 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1caa8576-2227-472e-a26a-9ef4fe79bb92 None None] MFA Rules not processed for user `a0b2d650f7484354a7078846dec1f581`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:03.777209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1caa8576-2227-472e-a26a-9ef4fe79bb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:03.848018 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1378/2753] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:03.854376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c062c6a-1a55-4f3c-ad60-ce2880f837a5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:03.865937 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:03.924936 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c062c6a-1a55-4f3c-ad60-ce2880f837a5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:03.930097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1077de1-a34a-4fba-8c7d-6b4615193783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:03.930757 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077de1-a34a-4fba-8c7d-6b4615193783 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:03.931037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077de1-a34a-4fba-8c7d-6b4615193783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:03.931311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1077de1-a34a-4fba-8c7d-6b4615193783 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:03.931997 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1077de1-a34a-4fba-8c7d-6b4615193783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:03.933913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1077de1-a34a-4fba-8c7d-6b4615193783 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:03.962979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1376/2754] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:40:03 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:40:03.969335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa8576-2227-472e-a26a-9ef4fe79bb92 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:03.980091 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa8576-2227-472e-a26a-9ef4fe79bb92 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:04.043847 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4eef0-9911-4231-b22e-38eb0b16eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:04.044985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4eef0-9911-4231-b22e-38eb0b16eef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:04.045461 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4eef0-9911-4231-b22e-38eb0b16eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:04.045894 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4eef0-9911-4231-b22e-38eb0b16eef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:04.047098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4eef0-9911-4231-b22e-38eb0b16eef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:04.049384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4eef0-9911-4231-b22e-38eb0b16eef5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:04.072072 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1379/2755] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:40:03 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:40:04.077021 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1077de1-a34a-4fba-8c7d-6b4615193783 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:04.088051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1077de1-a34a-4fba-8c7d-6b4615193783 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:04.092793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0db731-abe0-4493-92fd-fa41152f8905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:04.093489 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db731-abe0-4493-92fd-fa41152f8905 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:04.093773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db731-abe0-4493-92fd-fa41152f8905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:04.094050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db731-abe0-4493-92fd-fa41152f8905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:04.094796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0db731-abe0-4493-92fd-fa41152f8905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:04.096473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0db731-abe0-4493-92fd-fa41152f8905 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:04.107015 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1377/2756] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:04.111332 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4eef0-9911-4231-b22e-38eb0b16eef5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:04.116710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:04.122751 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4eef0-9911-4231-b22e-38eb0b16eef5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:04.128293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a61b2-36e9-4c39-ad7d-05e43ec7c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:04.129178 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a61b2-36e9-4c39-ad7d-05e43ec7c4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:04.129475 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a61b2-36e9-4c39-ad7d-05e43ec7c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:04.129731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a61b2-36e9-4c39-ad7d-05e43ec7c4a5 admin admin] PATH_INFO: `/v3/projects/e0efbd1050de47d09763f05a5cb5832d/users/06d99ba3344945b793e025baa4ca2071/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:04.144640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a61b2-36e9-4c39-ad7d-05e43ec7c4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0efbd1050de47d09763f05a5cb5832d, user_id=06d99ba3344945b793e025baa4ca2071, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:04.147331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a61b2-36e9-4c39-ad7d-05e43ec7c4a5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:04.161951 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1380/2757] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:40:04 2022] PUT /identity/v3/projects/e0efbd1050de47d09763f05a5cb5832d/users/06d99ba3344945b793e025baa4ca2071/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:40:04.166068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0db731-abe0-4493-92fd-fa41152f8905 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:04.176634 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0db731-abe0-4493-92fd-fa41152f8905 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:04.234126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6444b-2cd8-4d18-ac45-2aca077da646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:04.234839 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6444b-2cd8-4d18-ac45-2aca077da646 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:04.235121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6444b-2cd8-4d18-ac45-2aca077da646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:04.235404 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6444b-2cd8-4d18-ac45-2aca077da646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:04.236181 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6444b-2cd8-4d18-ac45-2aca077da646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:04.237833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6444b-2cd8-4d18-ac45-2aca077da646 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:04.248400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1378/2758] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:04.252922 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a61b2-36e9-4c39-ad7d-05e43ec7c4a5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:04.263858 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a61b2-36e9-4c39-ad7d-05e43ec7c4a5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:04.270186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc91e8-7325-47d9-9ee6-b819f05536d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:04.271109 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc91e8-7325-47d9-9ee6-b819f05536d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:04.271390 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc91e8-7325-47d9-9ee6-b819f05536d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:04.271669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc91e8-7325-47d9-9ee6-b819f05536d4 admin admin] PATH_INFO: `/v3/projects/e0efbd1050de47d09763f05a5cb5832d/users/06d99ba3344945b793e025baa4ca2071/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:04.273972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc91e8-7325-47d9-9ee6-b819f05536d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0efbd1050de47d09763f05a5cb5832d, user_id=06d99ba3344945b793e025baa4ca2071, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:04.276661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc91e8-7325-47d9-9ee6-b819f05536d4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:04.288041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1381/2759] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:40:04 2022] PUT /identity/v3/projects/e0efbd1050de47d09763f05a5cb5832d/users/06d99ba3344945b793e025baa4ca2071/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:04.355554 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bafa6-f47b-4e85-94f1-6d36f41118ec None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:04.355948 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bafa6-f47b-4e85-94f1-6d36f41118ec None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:04.356467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bafa6-f47b-4e85-94f1-6d36f41118ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:04.385193 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-603bafa6-f47b-4e85-94f1-6d36f41118ec None None] MFA Rules not processed for user `06d99ba3344945b793e025baa4ca2071`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:04.386413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-603bafa6-f47b-4e85-94f1-6d36f41118ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:04.465895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1379/2760] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:04.477106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc91e8-7325-47d9-9ee6-b819f05536d4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:04.479182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c2dc91e8-7325-47d9-9ee6-b819f05536d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:04.541522 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc91e8-7325-47d9-9ee6-b819f05536d4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:04.545427 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333c6b2-e4bc-4f1f-af8e-a2903b64f80c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:04.546059 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333c6b2-e4bc-4f1f-af8e-a2903b64f80c service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:04.546335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333c6b2-e4bc-4f1f-af8e-a2903b64f80c service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:04.546764 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333c6b2-e4bc-4f1f-af8e-a2903b64f80c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:04.555554 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333c6b2-e4bc-4f1f-af8e-a2903b64f80c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:04.557046 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333c6b2-e4bc-4f1f-af8e-a2903b64f80c service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:04.566443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1382/2761] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:04.700260 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bafa6-f47b-4e85-94f1-6d36f41118ec None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:04.704754 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:04.766510 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bafa6-f47b-4e85-94f1-6d36f41118ec None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:04.771625 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:04.772541 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:04.772818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:04.773092 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] PATH_INFO: `/v3/users/a0b2d650f7484354a7078846dec1f581` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:04.774440 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b2d650f7484354a7078846dec1f581)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:04.776373 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:04.827485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b2d650f7484354a7078846dec1f581'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:04.839234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b2d650f7484354a7078846dec1f581'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:04.848389 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b2d650f7484354a7078846dec1f581'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:04.855545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b2d650f7484354a7078846dec1f581'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:04.856285 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b2d650f7484354a7078846dec1f581'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:04.862562 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1380/2762] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:40:04 2022] DELETE /identity/v3/users/a0b2d650f7484354a7078846dec1f581 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:04.867183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9670fa-6f75-4f22-bde9-b311d1f9ffd4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:04.867665 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9670fa-6f75-4f22-bde9-b311d1f9ffd4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:04.867766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9670fa-6f75-4f22-bde9-b311d1f9ffd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:04.885984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5a9670fa-6f75-4f22-bde9-b311d1f9ffd4 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:04.887165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5a9670fa-6f75-4f22-bde9-b311d1f9ffd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:04.961187 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1383/2763] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:04.971200 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:04.973004 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:05.042126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df3f81-f71d-4fe2-a1cf-04789de3eec3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:05.046445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5a509-d4e6-438f-9057-ef33779d393b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:05.047506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5a509-d4e6-438f-9057-ef33779d393b service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:05.047788 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5a509-d4e6-438f-9057-ef33779d393b service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:05.048087 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5a509-d4e6-438f-9057-ef33779d393b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:05.058477 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5a509-d4e6-438f-9057-ef33779d393b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:05.060874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5a509-d4e6-438f-9057-ef33779d393b service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:05.076572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1381/2764] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:05.354165 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9670fa-6f75-4f22-bde9-b311d1f9ffd4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:05.355921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5a9670fa-6f75-4f22-bde9-b311d1f9ffd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:05.369279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9670fa-6f75-4f22-bde9-b311d1f9ffd4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:05.374961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:05.376329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:05.376791 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:05.377161 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] PATH_INFO: `/v3/projects/616f0e1fa400442484a6db461db88ccf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:05.378462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=616f0e1fa400442484a6db461db88ccf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:05.380469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:05.430879 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616f0e1fa400442484a6db461db88ccf', 'request_id': 'req-40fabbed-a740-4460-b0cc-6aab0a258a53'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:05.439043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616f0e1fa400442484a6db461db88ccf', 'request_id': 'req-40fabbed-a740-4460-b0cc-6aab0a258a53'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:05.445322 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616f0e1fa400442484a6db461db88ccf', 'request_id': 'req-40fabbed-a740-4460-b0cc-6aab0a258a53'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:05.447236 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:05.458513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] The token cache is being invalidate because project 616f0e1fa400442484a6db461db88ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:40:05.458800 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:05.459462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:05.461080 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1384/2765] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:40:05 2022] DELETE /identity/v3/projects/616f0e1fa400442484a6db461db88ccf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:05.465118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5a509-d4e6-438f-9057-ef33779d393b service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:05.475828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5a509-d4e6-438f-9057-ef33779d393b service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:05.497385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:05.674626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:05.675505 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:05.675792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:05.676126 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] PATH_INFO: `/v3/users/06d99ba3344945b793e025baa4ca2071` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:05.677355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d99ba3344945b793e025baa4ca2071)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:05.679325 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:05.731479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d99ba3344945b793e025baa4ca2071'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:05.743956 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d99ba3344945b793e025baa4ca2071'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:05.753098 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d99ba3344945b793e025baa4ca2071'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:05.760436 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d99ba3344945b793e025baa4ca2071'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:05.761079 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-150ea703-39a5-4905-a3de-4e22f82d2b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d99ba3344945b793e025baa4ca2071'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:05.767402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1382/2766] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:40:05 2022] DELETE /identity/v3/users/06d99ba3344945b793e025baa4ca2071 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:06.066945 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:06.068453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:06.082225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fabbed-a740-4460-b0cc-6aab0a258a53 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:06.143576 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:06.144492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.144756 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.145027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] PATH_INFO: `/v3/projects/e0efbd1050de47d09763f05a5cb5832d` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.146205 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0efbd1050de47d09763f05a5cb5832d)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:06.148154 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:06.198625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0efbd1050de47d09763f05a5cb5832d', 'request_id': 'req-5edbe387-e630-42b0-899f-fe40d6d7bb61'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:06.207619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0efbd1050de47d09763f05a5cb5832d', 'request_id': 'req-5edbe387-e630-42b0-899f-fe40d6d7bb61'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:06.214123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0efbd1050de47d09763f05a5cb5832d', 'request_id': 'req-5edbe387-e630-42b0-899f-fe40d6d7bb61'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:06.224853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] The token cache is being invalidate because project e0efbd1050de47d09763f05a5cb5832d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:40:06.225135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:06.225776 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5edbe387-e630-42b0-899f-fe40d6d7bb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:06.227340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1385/2767] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:40:06 2022] DELETE /identity/v3/projects/e0efbd1050de47d09763f05a5cb5832d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:06.232586 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52382b42-fa06-41e7-b8ee-9fab723506c9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.232905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52382b42-fa06-41e7-b8ee-9fab723506c9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.233186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52382b42-fa06-41e7-b8ee-9fab723506c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.252993 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-52382b42-fa06-41e7-b8ee-9fab723506c9 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:06.254213 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-52382b42-fa06-41e7-b8ee-9fab723506c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:06.316828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1383/2768] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:06.325071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4daa3-ea93-44d3-b5ae-8ceab596e696 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.325373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4daa3-ea93-44d3-b5ae-8ceab596e696 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.325629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4daa3-ea93-44d3-b5ae-8ceab596e696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.345810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3ad4daa3-ea93-44d3-b5ae-8ceab596e696 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:06.347002 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3ad4daa3-ea93-44d3-b5ae-8ceab596e696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:06.355358 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1386/2769] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:06.361274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52382b42-fa06-41e7-b8ee-9fab723506c9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:06.371509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52382b42-fa06-41e7-b8ee-9fab723506c9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:06.377023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0611d-bb21-486d-9648-028dcec5c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:06.377677 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0611d-bb21-486d-9648-028dcec5c1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.377953 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0611d-bb21-486d-9648-028dcec5c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.378223 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0611d-bb21-486d-9648-028dcec5c1a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.378962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0611d-bb21-486d-9648-028dcec5c1a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:40:06.379264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0611d-bb21-486d-9648-028dcec5c1a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:06.380976 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0611d-bb21-486d-9648-028dcec5c1a1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:06.393097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1384/2770] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:40:06.397384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4daa3-ea93-44d3-b5ae-8ceab596e696 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:06.406933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4daa3-ea93-44d3-b5ae-8ceab596e696 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:06.412221 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fde52d-f49c-4c8d-b87c-226597456f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:06.412862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fde52d-f49c-4c8d-b87c-226597456f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.413141 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fde52d-f49c-4c8d-b87c-226597456f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.413405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fde52d-f49c-4c8d-b87c-226597456f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.414086 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fde52d-f49c-4c8d-b87c-226597456f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:06.415991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fde52d-f49c-4c8d-b87c-226597456f13 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:06.443251 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1387/2771] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:40:06 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:40:06.447671 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0611d-bb21-486d-9648-028dcec5c1a1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:06.458165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0611d-bb21-486d-9648-028dcec5c1a1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:06.494000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:06.529547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f205e-dfc4-422b-96c8-ae1038e8c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:06.530220 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f205e-dfc4-422b-96c8-ae1038e8c6ab admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.530496 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f205e-dfc4-422b-96c8-ae1038e8c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.530763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f205e-dfc4-422b-96c8-ae1038e8c6ab admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.531457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f205e-dfc4-422b-96c8-ae1038e8c6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:06.533526 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f205e-dfc4-422b-96c8-ae1038e8c6ab admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:06.555452 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1385/2772] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:40:06 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:40:06.561852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fde52d-f49c-4c8d-b87c-226597456f13 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:06.578455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fde52d-f49c-4c8d-b87c-226597456f13 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:06.583813 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefb01d-9bf4-4112-8563-6d5cb4f16f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:06.584499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefb01d-9bf4-4112-8563-6d5cb4f16f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.584781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefb01d-9bf4-4112-8563-6d5cb4f16f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.585054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefb01d-9bf4-4112-8563-6d5cb4f16f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.585788 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefb01d-9bf4-4112-8563-6d5cb4f16f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:06.587405 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefb01d-9bf4-4112-8563-6d5cb4f16f91 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:06.598159 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1388/2773] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:06.602412 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f205e-dfc4-422b-96c8-ae1038e8c6ab admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:06.613642 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f205e-dfc4-422b-96c8-ae1038e8c6ab admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:06.619856 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3755b2b-71b1-485a-b7fe-8b998a26cc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:06.620578 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3755b2b-71b1-485a-b7fe-8b998a26cc2b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.620858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3755b2b-71b1-485a-b7fe-8b998a26cc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.621129 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3755b2b-71b1-485a-b7fe-8b998a26cc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.621861 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3755b2b-71b1-485a-b7fe-8b998a26cc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:06.623469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3755b2b-71b1-485a-b7fe-8b998a26cc2b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:06.634660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1386/2774] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:06.638935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefb01d-9bf4-4112-8563-6d5cb4f16f91 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:06.650919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefb01d-9bf4-4112-8563-6d5cb4f16f91 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:06.656027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d742a-4eef-4efb-b0d4-3adffac561d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:06.657911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d742a-4eef-4efb-b0d4-3adffac561d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.658196 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d742a-4eef-4efb-b0d4-3adffac561d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.658468 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d742a-4eef-4efb-b0d4-3adffac561d5 admin admin] PATH_INFO: `/v3/projects/ba4e7c2929164a76825cb776dee5437f/users/f792964feab141959f5c38d40c58dbb4/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.674744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d742a-4eef-4efb-b0d4-3adffac561d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4e7c2929164a76825cb776dee5437f, user_id=f792964feab141959f5c38d40c58dbb4, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:06.677448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d742a-4eef-4efb-b0d4-3adffac561d5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:06.693926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1389/2775] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:40:06 2022] PUT /identity/v3/projects/ba4e7c2929164a76825cb776dee5437f/users/f792964feab141959f5c38d40c58dbb4/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:06.706750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc39c7-1fab-48e2-be5f-2f78ea716f4d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.707138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc39c7-1fab-48e2-be5f-2f78ea716f4d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.707416 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc39c7-1fab-48e2-be5f-2f78ea716f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.738610 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-51bc39c7-1fab-48e2-be5f-2f78ea716f4d None None] MFA Rules not processed for user `f792964feab141959f5c38d40c58dbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:06.739722 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-51bc39c7-1fab-48e2-be5f-2f78ea716f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:06.808315 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1387/2776] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:06.813198 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d742a-4eef-4efb-b0d4-3adffac561d5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:06.834887 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:06.883123 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d742a-4eef-4efb-b0d4-3adffac561d5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:06.890384 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e26d1e-f660-4332-984e-59aa604cfd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:06.891211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e26d1e-f660-4332-984e-59aa604cfd24 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.891498 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e26d1e-f660-4332-984e-59aa604cfd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.891770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e26d1e-f660-4332-984e-59aa604cfd24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.892512 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e26d1e-f660-4332-984e-59aa604cfd24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:06.894440 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e26d1e-f660-4332-984e-59aa604cfd24 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:06.922189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1390/2777] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:40:06 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 18:40:06.926408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc39c7-1fab-48e2-be5f-2f78ea716f4d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:06.937235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc39c7-1fab-48e2-be5f-2f78ea716f4d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:06.996244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5c5df-7ca1-4a87-90e3-9655da4b291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:06.996837 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5c5df-7ca1-4a87-90e3-9655da4b291c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:06.997150 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5c5df-7ca1-4a87-90e3-9655da4b291c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:06.997422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5c5df-7ca1-4a87-90e3-9655da4b291c admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:06.998081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5c5df-7ca1-4a87-90e3-9655da4b291c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:07.000333 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5c5df-7ca1-4a87-90e3-9655da4b291c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:07.024626 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1388/2778] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:40:06 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:40:07.028834 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e26d1e-f660-4332-984e-59aa604cfd24 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:07.039586 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e26d1e-f660-4332-984e-59aa604cfd24 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:07.044449 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f10e3-d601-4131-a2e9-7be43d602165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:07.045103 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f10e3-d601-4131-a2e9-7be43d602165 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:07.045389 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f10e3-d601-4131-a2e9-7be43d602165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:07.045652 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f10e3-d601-4131-a2e9-7be43d602165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:07.046377 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f10e3-d601-4131-a2e9-7be43d602165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:07.048101 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f10e3-d601-4131-a2e9-7be43d602165 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:07.060367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1391/2779] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:07.065237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5c5df-7ca1-4a87-90e3-9655da4b291c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:07.080418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5c5df-7ca1-4a87-90e3-9655da4b291c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:07.085227 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c5aed-1d70-4a12-abdf-53ae44b8fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:07.086141 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5aed-1d70-4a12-abdf-53ae44b8fbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:07.086422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5aed-1d70-4a12-abdf-53ae44b8fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:07.086736 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5aed-1d70-4a12-abdf-53ae44b8fbe3 admin admin] PATH_INFO: `/v3/projects/0072865427104c0ab68e27b4a7b8107c/users/ac8661fcb40541c98cbc48145dc7fd16/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:07.103175 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c5aed-1d70-4a12-abdf-53ae44b8fbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0072865427104c0ab68e27b4a7b8107c, user_id=ac8661fcb40541c98cbc48145dc7fd16, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:07.105881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c5aed-1d70-4a12-abdf-53ae44b8fbe3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:07.124943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1389/2780] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:40:07 2022] PUT /identity/v3/projects/0072865427104c0ab68e27b4a7b8107c/users/ac8661fcb40541c98cbc48145dc7fd16/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:07.129447 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f10e3-d601-4131-a2e9-7be43d602165 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:07.139606 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f10e3-d601-4131-a2e9-7be43d602165 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:07.198434 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101186d-cfc1-41f7-8b4a-7759f1cc0d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:07.199111 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101186d-cfc1-41f7-8b4a-7759f1cc0d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:07.199395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101186d-cfc1-41f7-8b4a-7759f1cc0d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:07.199672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101186d-cfc1-41f7-8b4a-7759f1cc0d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:07.200436 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101186d-cfc1-41f7-8b4a-7759f1cc0d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:07.202052 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101186d-cfc1-41f7-8b4a-7759f1cc0d07 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:07.211926 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1392/2781] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:07.216306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c5aed-1d70-4a12-abdf-53ae44b8fbe3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:07.223037 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:07.227527 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c5aed-1d70-4a12-abdf-53ae44b8fbe3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:07.233301 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e046c-9ee0-4b8a-b452-391a7de3f203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:07.234198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e046c-9ee0-4b8a-b452-391a7de3f203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:07.234560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e046c-9ee0-4b8a-b452-391a7de3f203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:07.234843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e046c-9ee0-4b8a-b452-391a7de3f203 admin admin] PATH_INFO: `/v3/projects/0072865427104c0ab68e27b4a7b8107c/users/ac8661fcb40541c98cbc48145dc7fd16/roles/9f557e97d94b4b499a6765419452e1ef` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:07.237176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e046c-9ee0-4b8a-b452-391a7de3f203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0072865427104c0ab68e27b4a7b8107c, user_id=ac8661fcb40541c98cbc48145dc7fd16, role_id=9f557e97d94b4b499a6765419452e1ef)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:07.239812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e046c-9ee0-4b8a-b452-391a7de3f203 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:07.250622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1390/2782] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:40:07 2022] PUT /identity/v3/projects/0072865427104c0ab68e27b4a7b8107c/users/ac8661fcb40541c98cbc48145dc7fd16/roles/9f557e97d94b4b499a6765419452e1ef => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:07.260917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0f97-38b5-4a35-a02a-9cf0e7fb59b2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:07.261209 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0f97-38b5-4a35-a02a-9cf0e7fb59b2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:07.261485 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e0f97-38b5-4a35-a02a-9cf0e7fb59b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:07.290030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-498e0f97-38b5-4a35-a02a-9cf0e7fb59b2 None None] MFA Rules not processed for user `ac8661fcb40541c98cbc48145dc7fd16`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:07.291292 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-498e0f97-38b5-4a35-a02a-9cf0e7fb59b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:07.362721 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1393/2783] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:07.374566 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e046c-9ee0-4b8a-b452-391a7de3f203 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:07.376585 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-535e046c-9ee0-4b8a-b452-391a7de3f203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:07.440650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e046c-9ee0-4b8a-b452-391a7de3f203 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:07.445422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce937da-fa44-47a6-8890-04e3f084facf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:07.446259 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce937da-fa44-47a6-8890-04e3f084facf service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:07.446604 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce937da-fa44-47a6-8890-04e3f084facf service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:07.446958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce937da-fa44-47a6-8890-04e3f084facf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:07.461583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce937da-fa44-47a6-8890-04e3f084facf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:07.463731 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce937da-fa44-47a6-8890-04e3f084facf service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:07.475540 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1391/2784] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:07.862071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e0f97-38b5-4a35-a02a-9cf0e7fb59b2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:07.877351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:07.933420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e0f97-38b5-4a35-a02a-9cf0e7fb59b2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:07.938601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:07.939478 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:07.939755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:07.940031 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] PATH_INFO: `/v3/users/f792964feab141959f5c38d40c58dbb4` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:07.941284 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f792964feab141959f5c38d40c58dbb4)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:07.943225 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:07.993152 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f792964feab141959f5c38d40c58dbb4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:07.993819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f792964feab141959f5c38d40c58dbb4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.007065 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f792964feab141959f5c38d40c58dbb4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.007645 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f792964feab141959f5c38d40c58dbb4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.015860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f792964feab141959f5c38d40c58dbb4'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.030331 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1394/2785] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:40:07 2022] DELETE /identity/v3/users/f792964feab141959f5c38d40c58dbb4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:08.035457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8560-7a8a-44d2-b796-b68a6175b18d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:08.035932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8560-7a8a-44d2-b796-b68a6175b18d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:08.036051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8560-7a8a-44d2-b796-b68a6175b18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:08.053159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-81ee8560-7a8a-44d2-b796-b68a6175b18d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:08.054354 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-81ee8560-7a8a-44d2-b796-b68a6175b18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:08.115313 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1392/2786] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:08.127671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:08.129316 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:08.195222 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d68e37-d8e4-46f4-baf0-2efc7e8c593b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:08.199617 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c19537-370b-4c26-8981-f2b3b846f87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:08.200302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c19537-370b-4c26-8981-f2b3b846f87b service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:08.200580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c19537-370b-4c26-8981-f2b3b846f87b service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:08.200848 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c19537-370b-4c26-8981-f2b3b846f87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:08.210795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c19537-370b-4c26-8981-f2b3b846f87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:08.212253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c19537-370b-4c26-8981-f2b3b846f87b service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:08.221843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1395/2787] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:08.497344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee8560-7a8a-44d2-b796-b68a6175b18d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:08.498969 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-81ee8560-7a8a-44d2-b796-b68a6175b18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:08.512429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee8560-7a8a-44d2-b796-b68a6175b18d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:08.517504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:08.518355 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:08.518664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:08.518996 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] PATH_INFO: `/v3/projects/ba4e7c2929164a76825cb776dee5437f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:08.520371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4e7c2929164a76825cb776dee5437f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:08.522279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:08.583009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4e7c2929164a76825cb776dee5437f', 'request_id': 'req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.590209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4e7c2929164a76825cb776dee5437f', 'request_id': 'req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.597447 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4e7c2929164a76825cb776dee5437f', 'request_id': 'req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.612217 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] The token cache is being invalidate because project ba4e7c2929164a76825cb776dee5437f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:40:08.612502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.613120 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.614659 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1393/2788] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:40:08 2022] DELETE /identity/v3/projects/ba4e7c2929164a76825cb776dee5437f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:08.618780 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c19537-370b-4c26-8981-f2b3b846f87b service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:08.628936 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c19537-370b-4c26-8981-f2b3b846f87b service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:08.661920 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:08.689668 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:08.690573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:08.690865 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:08.691139 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] PATH_INFO: `/v3/users/ac8661fcb40541c98cbc48145dc7fd16` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:08.692463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8661fcb40541c98cbc48145dc7fd16)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:08.694505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:08.745279 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8661fcb40541c98cbc48145dc7fd16'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.746035 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8661fcb40541c98cbc48145dc7fd16'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.759823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8661fcb40541c98cbc48145dc7fd16'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.760530 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8661fcb40541c98cbc48145dc7fd16'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.767882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b9a69154-51d5-424b-9254-1a8f043eb65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8661fcb40541c98cbc48145dc7fd16'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:08.783826 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1396/2789] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:40:08 2022] DELETE /identity/v3/users/ac8661fcb40541c98cbc48145dc7fd16 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:09.068649 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:09.070125 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:09.083949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1044f1-b454-46e7-96b4-9bfaf9ec934d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:09.098311 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:09.144631 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:09.145432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.145710 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.145981 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] PATH_INFO: `/v3/projects/0072865427104c0ab68e27b4a7b8107c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.147182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0072865427104c0ab68e27b4a7b8107c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:09.149110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:09.198991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0072865427104c0ab68e27b4a7b8107c', 'request_id': 'req-88173e83-c206-4dc0-85be-0e756fbbbb82'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:09.204465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0072865427104c0ab68e27b4a7b8107c', 'request_id': 'req-88173e83-c206-4dc0-85be-0e756fbbbb82'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:09.210536 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0072865427104c0ab68e27b4a7b8107c', 'request_id': 'req-88173e83-c206-4dc0-85be-0e756fbbbb82'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:09.223908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] The token cache is being invalidate because project 0072865427104c0ab68e27b4a7b8107c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:40:09.224219 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:09.224846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-88173e83-c206-4dc0-85be-0e756fbbbb82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:09.226386 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1394/2790] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:40:09 2022] DELETE /identity/v3/projects/0072865427104c0ab68e27b4a7b8107c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:09.231463 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d72fa-a47b-4cb9-af78-63225dcc6b9c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.231968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d72fa-a47b-4cb9-af78-63225dcc6b9c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.232105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d72fa-a47b-4cb9-af78-63225dcc6b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.250823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6f7d72fa-a47b-4cb9-af78-63225dcc6b9c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:09.252036 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6f7d72fa-a47b-4cb9-af78-63225dcc6b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:09.310694 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1397/2791] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:09.318877 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67cee-768d-42b6-a377-39ac5005fc9d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.319319 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67cee-768d-42b6-a377-39ac5005fc9d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.319418 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67cee-768d-42b6-a377-39ac5005fc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.337669 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-eeb67cee-768d-42b6-a377-39ac5005fc9d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:09.338858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eeb67cee-768d-42b6-a377-39ac5005fc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:09.347157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1395/2792] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:09.351596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d72fa-a47b-4cb9-af78-63225dcc6b9c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:09.362108 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d72fa-a47b-4cb9-af78-63225dcc6b9c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:09.367695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bcbb4-4dc6-4312-b628-37472dff948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:09.368385 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bcbb4-4dc6-4312-b628-37472dff948a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.368672 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bcbb4-4dc6-4312-b628-37472dff948a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.368943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bcbb4-4dc6-4312-b628-37472dff948a admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.369678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bcbb4-4dc6-4312-b628-37472dff948a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:40:09.369985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bcbb4-4dc6-4312-b628-37472dff948a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:09.371600 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bcbb4-4dc6-4312-b628-37472dff948a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:09.384238 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1398/2793] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:40:09.388801 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67cee-768d-42b6-a377-39ac5005fc9d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:09.398429 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67cee-768d-42b6-a377-39ac5005fc9d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:09.403967 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f3065-6755-4683-9a62-68fab32a2267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:09.404648 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3065-6755-4683-9a62-68fab32a2267 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.404930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3065-6755-4683-9a62-68fab32a2267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.405202 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3065-6755-4683-9a62-68fab32a2267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.405895 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f3065-6755-4683-9a62-68fab32a2267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:09.407843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f3065-6755-4683-9a62-68fab32a2267 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:09.441902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1396/2794] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:40:09 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:40:09.447023 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bcbb4-4dc6-4312-b628-37472dff948a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:09.459772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bcbb4-4dc6-4312-b628-37472dff948a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:09.500859 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:09.522583 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83559c-b42e-4517-b4bb-378fd736e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:09.523288 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83559c-b42e-4517-b4bb-378fd736e552 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.523572 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83559c-b42e-4517-b4bb-378fd736e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.523845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83559c-b42e-4517-b4bb-378fd736e552 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.524647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83559c-b42e-4517-b4bb-378fd736e552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:09.526619 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83559c-b42e-4517-b4bb-378fd736e552 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:09.548973 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1399/2795] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:40:09 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:40:09.553407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f3065-6755-4683-9a62-68fab32a2267 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:09.564576 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f3065-6755-4683-9a62-68fab32a2267 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:09.569813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ebd70-0497-43eb-91a9-ed5a9f7fc340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:09.570485 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ebd70-0497-43eb-91a9-ed5a9f7fc340 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.570766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ebd70-0497-43eb-91a9-ed5a9f7fc340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.571042 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ebd70-0497-43eb-91a9-ed5a9f7fc340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.571784 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ebd70-0497-43eb-91a9-ed5a9f7fc340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:09.573446 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ebd70-0497-43eb-91a9-ed5a9f7fc340 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:09.584310 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1397/2796] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:09.588542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83559c-b42e-4517-b4bb-378fd736e552 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:09.598951 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83559c-b42e-4517-b4bb-378fd736e552 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:09.604082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee991c-a407-404f-af8b-dd987546e0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:09.604735 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee991c-a407-404f-af8b-dd987546e0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.605019 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee991c-a407-404f-af8b-dd987546e0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.605296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee991c-a407-404f-af8b-dd987546e0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.606028 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee991c-a407-404f-af8b-dd987546e0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:09.607621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee991c-a407-404f-af8b-dd987546e0d6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:09.618505 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1400/2797] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:09.622651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ebd70-0497-43eb-91a9-ed5a9f7fc340 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:09.633372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ebd70-0497-43eb-91a9-ed5a9f7fc340 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:09.638276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cbd44-2c77-4a8e-83bf-444e71776000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:09.639163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cbd44-2c77-4a8e-83bf-444e71776000 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.639444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cbd44-2c77-4a8e-83bf-444e71776000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.639720 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cbd44-2c77-4a8e-83bf-444e71776000 admin admin] PATH_INFO: `/v3/projects/98642ae31e7540fdb73ed34930edc728/users/735ac600b87747129210097534ab753c/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.655071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cbd44-2c77-4a8e-83bf-444e71776000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98642ae31e7540fdb73ed34930edc728, user_id=735ac600b87747129210097534ab753c, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:09.657798 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cbd44-2c77-4a8e-83bf-444e71776000 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:09.673159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1398/2798] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:40:09 2022] PUT /identity/v3/projects/98642ae31e7540fdb73ed34930edc728/users/735ac600b87747129210097534ab753c/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:09.684911 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec98f-dbc2-4b9d-9447-bf723b6f8682 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.685239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec98f-dbc2-4b9d-9447-bf723b6f8682 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.685516 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec98f-dbc2-4b9d-9447-bf723b6f8682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.712669 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ddaec98f-dbc2-4b9d-9447-bf723b6f8682 None None] MFA Rules not processed for user `735ac600b87747129210097534ab753c`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:09.713892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ddaec98f-dbc2-4b9d-9447-bf723b6f8682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:09.781024 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1401/2799] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:09.792939 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cbd44-2c77-4a8e-83bf-444e71776000 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:09.794792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6f4cbd44-2c77-4a8e-83bf-444e71776000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:09.845140 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:09.860226 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cbd44-2c77-4a8e-83bf-444e71776000 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:09.865154 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f8010-ef77-4333-91ae-69ed912de7f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:09.865843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f8010-ef77-4333-91ae-69ed912de7f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:09.866128 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f8010-ef77-4333-91ae-69ed912de7f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:09.866402 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f8010-ef77-4333-91ae-69ed912de7f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:09.875966 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f8010-ef77-4333-91ae-69ed912de7f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:09.877432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f8010-ef77-4333-91ae-69ed912de7f1 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:09.886564 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1399/2800] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:14.125314 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaec98f-dbc2-4b9d-9447-bf723b6f8682 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:14.127264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ddaec98f-dbc2-4b9d-9447-bf723b6f8682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:14.140608 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaec98f-dbc2-4b9d-9447-bf723b6f8682 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:14.145087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9287b6-969f-47c1-9ae8-ee635dd5e5c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:14.145733 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9287b6-969f-47c1-9ae8-ee635dd5e5c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:14.146020 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9287b6-969f-47c1-9ae8-ee635dd5e5c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:14.146272 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9287b6-969f-47c1-9ae8-ee635dd5e5c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:14.148245 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7d9287b6-969f-47c1-9ae8-ee635dd5e5c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:14.216851 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9287b6-969f-47c1-9ae8-ee635dd5e5c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:14.218845 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9287b6-969f-47c1-9ae8-ee635dd5e5c3 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:14.230755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1402/2801] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:19.882451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:24.225027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:29.474189 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c4884-c006-46eb-ad47-f4f017f341d8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:29.474828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c4884-c006-46eb-ad47-f4f017f341d8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:29.474828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c4884-c006-46eb-ad47-f4f017f341d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:29.492392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7b2c4884-c006-46eb-ad47-f4f017f341d8 None None] MFA Rules not processed for user `cf94c76ba04b403b91a7ff77a2f476e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:29.493595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7b2c4884-c006-46eb-ad47-f4f017f341d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:29.501473 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1400/2802] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:33.332925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f58024-cc18-42fa-981f-23ea69b1539f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:33.333488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f58024-cc18-42fa-981f-23ea69b1539f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:33.333488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f58024-cc18-42fa-981f-23ea69b1539f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:33.352416 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e4f58024-cc18-42fa-981f-23ea69b1539f None None] MFA Rules not processed for user `6ceccf3f6ce044b98503b09b13cd2510`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:33.353624 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e4f58024-cc18-42fa-981f-23ea69b1539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:33.421793 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1403/2803] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:39.487307 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:39.669020 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c4884-c006-46eb-ad47-f4f017f341d8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:39.670859 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7b2c4884-c006-46eb-ad47-f4f017f341d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:39.774787 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c4884-c006-46eb-ad47-f4f017f341d8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:39.785664 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff2c50-7527-4130-8c0a-aea54702726f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:39.786972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2c50-7527-4130-8c0a-aea54702726f service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:39.786972 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2c50-7527-4130-8c0a-aea54702726f service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:39.787306 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2c50-7527-4130-8c0a-aea54702726f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:39.790341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-faff2c50-7527-4130-8c0a-aea54702726f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:39.806758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff2c50-7527-4130-8c0a-aea54702726f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:39.808403 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff2c50-7527-4130-8c0a-aea54702726f service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:39.832968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1401/2804] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:42.409186 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f58024-cc18-42fa-981f-23ea69b1539f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:42.472573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f58024-cc18-42fa-981f-23ea69b1539f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:42.476915 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:42.477871 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:42.478211 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:42.478517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] PATH_INFO: `/v3/users/735ac600b87747129210097534ab753c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:42.479770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=735ac600b87747129210097534ab753c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:42.481774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:42.537860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735ac600b87747129210097534ab753c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:42.538567 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735ac600b87747129210097534ab753c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:42.551766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735ac600b87747129210097534ab753c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:42.552487 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735ac600b87747129210097534ab753c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:42.559420 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735ac600b87747129210097534ab753c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:42.574508 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1404/2805] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:40:42 2022] DELETE /identity/v3/users/735ac600b87747129210097534ab753c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:42.579552 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247f275-7773-416f-982c-28f9a6e2260f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:42.580118 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247f275-7773-416f-982c-28f9a6e2260f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:42.580278 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247f275-7773-416f-982c-28f9a6e2260f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:42.598703 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0247f275-7773-416f-982c-28f9a6e2260f None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:42.599923 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0247f275-7773-416f-982c-28f9a6e2260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:42.668068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1402/2806] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:40:42.675723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:42.677223 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:42.707373 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:42.739069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f636-15fe-4dc6-b92a-a34348178155 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:42.742802 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3defe8-d970-4d5e-8bae-bb430b8d0538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:42.743492 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3defe8-d970-4d5e-8bae-bb430b8d0538 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:42.743777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3defe8-d970-4d5e-8bae-bb430b8d0538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:42.744081 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3defe8-d970-4d5e-8bae-bb430b8d0538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:42.754860 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3defe8-d970-4d5e-8bae-bb430b8d0538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:42.756364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3defe8-d970-4d5e-8bae-bb430b8d0538 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:42.766513 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1405/2807] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:43.053624 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247f275-7773-416f-982c-28f9a6e2260f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:43.055275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0247f275-7773-416f-982c-28f9a6e2260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:43.070579 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247f275-7773-416f-982c-28f9a6e2260f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:43.088424 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:43.089317 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.089601 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.089879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] PATH_INFO: `/v3/projects/98642ae31e7540fdb73ed34930edc728` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.091101 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=98642ae31e7540fdb73ed34930edc728)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:43.093119 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:43.146388 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98642ae31e7540fdb73ed34930edc728', 'request_id': 'req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:43.153871 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98642ae31e7540fdb73ed34930edc728', 'request_id': 'req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:43.161232 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98642ae31e7540fdb73ed34930edc728', 'request_id': 'req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:43.175136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] The token cache is being invalidate because project 98642ae31e7540fdb73ed34930edc728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:40:43.175421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:43.176077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d6c068d7-b28a-4e73-a1a1-5a3eb310ed8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:40:43.177930 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1403/2808] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:40:43 2022] DELETE /identity/v3/projects/98642ae31e7540fdb73ed34930edc728 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:43.182571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72c8d1-8974-4912-853a-81602c16fe0d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.182861 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72c8d1-8974-4912-853a-81602c16fe0d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.183135 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72c8d1-8974-4912-853a-81602c16fe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.202791 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6c72c8d1-8974-4912-853a-81602c16fe0d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:43.204044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6c72c8d1-8974-4912-853a-81602c16fe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:43.267913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1406/2809] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:43.276176 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4481bca-736c-454a-af5e-c6a8dfdfa631 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.276470 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4481bca-736c-454a-af5e-c6a8dfdfa631 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.276749 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4481bca-736c-454a-af5e-c6a8dfdfa631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.301163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a4481bca-736c-454a-af5e-c6a8dfdfa631 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:43.302407 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a4481bca-736c-454a-af5e-c6a8dfdfa631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:43.314490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1404/2810] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:43.318948 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72c8d1-8974-4912-853a-81602c16fe0d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:43.329798 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72c8d1-8974-4912-853a-81602c16fe0d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:43.334912 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6b1b8-ed8c-4f22-8bfc-7f940042706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:43.335585 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6b1b8-ed8c-4f22-8bfc-7f940042706b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.335870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6b1b8-ed8c-4f22-8bfc-7f940042706b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.336192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6b1b8-ed8c-4f22-8bfc-7f940042706b admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.336990 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6b1b8-ed8c-4f22-8bfc-7f940042706b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:40:43.337302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6b1b8-ed8c-4f22-8bfc-7f940042706b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:43.338917 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6b1b8-ed8c-4f22-8bfc-7f940042706b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:43.352890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1407/2811] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:40:43.357214 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4481bca-736c-454a-af5e-c6a8dfdfa631 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:43.361641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:43.371631 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4481bca-736c-454a-af5e-c6a8dfdfa631 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:43.378926 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbd26f-306d-4f7a-8ac7-fbd31f925fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:43.379594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbd26f-306d-4f7a-8ac7-fbd31f925fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.379876 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbd26f-306d-4f7a-8ac7-fbd31f925fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.380179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbd26f-306d-4f7a-8ac7-fbd31f925fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.380949 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbd26f-306d-4f7a-8ac7-fbd31f925fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:43.382818 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbd26f-306d-4f7a-8ac7-fbd31f925fe7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:43.411298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1405/2812] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:40:43 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:40:43.415643 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6b1b8-ed8c-4f22-8bfc-7f940042706b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:43.425685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6b1b8-ed8c-4f22-8bfc-7f940042706b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:43.485974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4a468-e67b-40b5-a9b9-28ecb3dbac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:43.486661 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4a468-e67b-40b5-a9b9-28ecb3dbac43 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.486943 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4a468-e67b-40b5-a9b9-28ecb3dbac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.487214 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4a468-e67b-40b5-a9b9-28ecb3dbac43 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.487913 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4a468-e67b-40b5-a9b9-28ecb3dbac43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:43.489890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4a468-e67b-40b5-a9b9-28ecb3dbac43 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:43.511396 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1408/2813] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:40:43 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:40:43.516420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbd26f-306d-4f7a-8ac7-fbd31f925fe7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:43.527077 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbd26f-306d-4f7a-8ac7-fbd31f925fe7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:43.532467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26f26-2021-4cb1-9476-e7888c6fb105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:43.533136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26f26-2021-4cb1-9476-e7888c6fb105 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.533417 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26f26-2021-4cb1-9476-e7888c6fb105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.533678 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26f26-2021-4cb1-9476-e7888c6fb105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.534743 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26f26-2021-4cb1-9476-e7888c6fb105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:43.536465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb26f26-2021-4cb1-9476-e7888c6fb105 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:43.548054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1406/2814] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:40:43.552138 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4a468-e67b-40b5-a9b9-28ecb3dbac43 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:43.563032 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4a468-e67b-40b5-a9b9-28ecb3dbac43 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:43.568027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ed951-87d5-4033-9aa1-135abe3b3a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:43.568769 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ed951-87d5-4033-9aa1-135abe3b3a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.569041 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ed951-87d5-4033-9aa1-135abe3b3a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.569321 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ed951-87d5-4033-9aa1-135abe3b3a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.570044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ed951-87d5-4033-9aa1-135abe3b3a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:43.571653 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ed951-87d5-4033-9aa1-135abe3b3a70 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:43.583620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1409/2815] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 18:40:43.587628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26f26-2021-4cb1-9476-e7888c6fb105 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:43.598521 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26f26-2021-4cb1-9476-e7888c6fb105 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:43.604222 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6f4dc-9bb0-42e5-8d0a-f9fab1952033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:43.605165 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6f4dc-9bb0-42e5-8d0a-f9fab1952033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.605509 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6f4dc-9bb0-42e5-8d0a-f9fab1952033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.605840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6f4dc-9bb0-42e5-8d0a-f9fab1952033 admin admin] PATH_INFO: `/v3/projects/3b3c3bbd2098439cafa1b70884a3edb5/users/281b2c41772447149d95d1c217691a8a/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.621947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6f4dc-9bb0-42e5-8d0a-f9fab1952033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3c3bbd2098439cafa1b70884a3edb5, user_id=281b2c41772447149d95d1c217691a8a, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:43.624733 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6f4dc-9bb0-42e5-8d0a-f9fab1952033 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:43.641393 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1407/2816] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:40:43 2022] PUT /identity/v3/projects/3b3c3bbd2098439cafa1b70884a3edb5/users/281b2c41772447149d95d1c217691a8a/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:40:43.652688 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe25da-b442-46bc-9f14-43cd4e7a7f80 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.652991 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe25da-b442-46bc-9f14-43cd4e7a7f80 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.653253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe25da-b442-46bc-9f14-43cd4e7a7f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.679774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4ebe25da-b442-46bc-9f14-43cd4e7a7f80 None None] MFA Rules not processed for user `281b2c41772447149d95d1c217691a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:40:43.680992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4ebe25da-b442-46bc-9f14-43cd4e7a7f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:43.701394 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:43.749066 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1410/2817] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:40:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:40:43.760515 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6f4dc-9bb0-42e5-8d0a-f9fab1952033 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:43.762358 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7ed6f4dc-9bb0-42e5-8d0a-f9fab1952033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:43.824778 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6f4dc-9bb0-42e5-8d0a-f9fab1952033 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:43.828587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0f76b-be5b-4096-be1a-4a83b6afd7f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4adc107bf542b8bb0502c7fbf94431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:43.829243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0f76b-be5b-4096-be1a-4a83b6afd7f5 service glance] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:43.829524 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0f76b-be5b-4096-be1a-4a83b6afd7f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:43.829796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0f76b-be5b-4096-be1a-4a83b6afd7f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:43.838467 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0f76b-be5b-4096-be1a-4a83b6afd7f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:43.839909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0f76b-be5b-4096-be1a-4a83b6afd7f5 service glance] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:43.848811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1408/2818] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:47.770195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe25da-b442-46bc-9f14-43cd4e7a7f80 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:47.772145 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4ebe25da-b442-46bc-9f14-43cd4e7a7f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:47.852641 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe25da-b442-46bc-9f14-43cd4e7a7f80 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:47.859379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e45dc-1366-4265-96eb-a45a40eadf47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:47.860120 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e45dc-1366-4265-96eb-a45a40eadf47 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:47.860371 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e45dc-1366-4265-96eb-a45a40eadf47 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:47.860649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e45dc-1366-4265-96eb-a45a40eadf47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:47.862761 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-954e45dc-1366-4265-96eb-a45a40eadf47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:47.876471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e45dc-1366-4265-96eb-a45a40eadf47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:47.878335 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e45dc-1366-4265-96eb-a45a40eadf47 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:47.893777 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1411/2819] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:53.113148 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0f76b-be5b-4096-be1a-4a83b6afd7f5 service glance] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:40:53.114683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-54c0f76b-be5b-4096-be1a-4a83b6afd7f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:53.177051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0f76b-be5b-4096-be1a-4a83b6afd7f5 service glance] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:40:53.181261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca414bc-554c-4950-b8e8-bba514ddebce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:40:53.181907 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca414bc-554c-4950-b8e8-bba514ddebce service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:40:53.182184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca414bc-554c-4950-b8e8-bba514ddebce service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:40:53.182451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca414bc-554c-4950-b8e8-bba514ddebce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:40:53.184618 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5ca414bc-554c-4950-b8e8-bba514ddebce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:40:53.267794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca414bc-554c-4950-b8e8-bba514ddebce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:40:53.269854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca414bc-554c-4950-b8e8-bba514ddebce service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:40:53.276054 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:40:53.286322 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1409/2820] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:40:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:40:57.885319 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=51 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:41:03.287758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:41:30.013573 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e45dc-1366-4265-96eb-a45a40eadf47 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:41:30.125972 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e45dc-1366-4265-96eb-a45a40eadf47 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:41:30.131656 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:41:30.132557 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:41:30.132838 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:41:30.133112 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] PATH_INFO: `/v3/users/281b2c41772447149d95d1c217691a8a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:41:30.134402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281b2c41772447149d95d1c217691a8a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:41:30.136401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:41:30.188810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281b2c41772447149d95d1c217691a8a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:41:30.189455 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281b2c41772447149d95d1c217691a8a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:41:30.201925 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281b2c41772447149d95d1c217691a8a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:41:30.204345 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281b2c41772447149d95d1c217691a8a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:41:30.212667 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281b2c41772447149d95d1c217691a8a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:41:30.228441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1412/2821] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:41:30 2022] DELETE /identity/v3/users/281b2c41772447149d95d1c217691a8a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:41:30.235269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07354c-6d87-4bdf-921c-682b4cbcb81d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:41:30.235883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07354c-6d87-4bdf-921c-682b4cbcb81d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:41:30.235883 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07354c-6d87-4bdf-921c-682b4cbcb81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:41:30.293218 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-db07354c-6d87-4bdf-921c-682b4cbcb81d None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:41:30.294761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-db07354c-6d87-4bdf-921c-682b4cbcb81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:41:30.359543 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1410/2822] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:41:30.370976 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:41:30.372836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:41:30.417924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:41:30.478966 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf45c8-a266-4282-856b-1b75f9f9be36 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:41:30.483589 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463c4ce-334b-4138-8b26-92bcc920da7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:41:30.484292 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c4ce-334b-4138-8b26-92bcc920da7f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:41:30.484576 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c4ce-334b-4138-8b26-92bcc920da7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:41:30.484852 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463c4ce-334b-4138-8b26-92bcc920da7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:41:30.494481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463c4ce-334b-4138-8b26-92bcc920da7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:41:30.495921 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463c4ce-334b-4138-8b26-92bcc920da7f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:41:30.505571 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1413/2823] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:41:30.796916 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07354c-6d87-4bdf-921c-682b4cbcb81d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:41:30.798444 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-db07354c-6d87-4bdf-921c-682b4cbcb81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:41:30.810727 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07354c-6d87-4bdf-921c-682b4cbcb81d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:41:30.816581 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:41:30.817468 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:41:30.817792 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:41:30.818111 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] PATH_INFO: `/v3/projects/3b3c3bbd2098439cafa1b70884a3edb5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:41:30.819363 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3c3bbd2098439cafa1b70884a3edb5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:41:30.821377 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:41:30.884209 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3c3bbd2098439cafa1b70884a3edb5', 'request_id': 'req-b0aa3b44-3071-42df-8c7a-a74e5bf68695'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:41:30.891860 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3c3bbd2098439cafa1b70884a3edb5', 'request_id': 'req-b0aa3b44-3071-42df-8c7a-a74e5bf68695'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:41:30.900763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3c3bbd2098439cafa1b70884a3edb5', 'request_id': 'req-b0aa3b44-3071-42df-8c7a-a74e5bf68695'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:41:30.918887 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] The token cache is being invalidate because project 3b3c3bbd2098439cafa1b70884a3edb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:41:30.919170 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:41:30.919912 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:41:30.921629 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1411/2824] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:41:30 2022] DELETE /identity/v3/projects/3b3c3bbd2098439cafa1b70884a3edb5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:41:40.501548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=25 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:41:40.915793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:42:04.294446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463c4ce-334b-4138-8b26-92bcc920da7f service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:42:04.296233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6463c4ce-334b-4138-8b26-92bcc920da7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:42:04.400483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463c4ce-334b-4138-8b26-92bcc920da7f service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:42:04.464087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cd664-3e7f-4be3-817a-dc0d7584c174 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:42:04.464843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd664-3e7f-4be3-817a-dc0d7584c174 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:42:04.465229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd664-3e7f-4be3-817a-dc0d7584c174 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:42:04.465609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cd664-3e7f-4be3-817a-dc0d7584c174 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:42:04.468855 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6b9cd664-3e7f-4be3-817a-dc0d7584c174 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:42:04.485230 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cd664-3e7f-4be3-817a-dc0d7584c174 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:42:04.486822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cd664-3e7f-4be3-817a-dc0d7584c174 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:42:04.497115 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1414/2825] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:42:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:42:14.492787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=67 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:42:37.313295 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:42:37.314805 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:42:37.397747 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa3b44-3071-42df-8c7a-a74e5bf68695 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:42:37.405069 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72e3b-a667-45da-9259-141d58b8fa2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:42:37.405709 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72e3b-a667-45da-9259-141d58b8fa2d service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:42:37.405963 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72e3b-a667-45da-9259-141d58b8fa2d service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:42:37.406261 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72e3b-a667-45da-9259-141d58b8fa2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:42:37.408268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-04f72e3b-a667-45da-9259-141d58b8fa2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:42:37.470019 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f72e3b-a667-45da-9259-141d58b8fa2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:42:37.471653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f72e3b-a667-45da-9259-141d58b8fa2d service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:42:37.480932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1412/2826] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:42:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:42:47.476845 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=59 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:42:58.138359 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b9724-5e76-4e53-b57a-fe0cea13e1f2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:42:58.138874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b9724-5e76-4e53-b57a-fe0cea13e1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:42:58.138998 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b9724-5e76-4e53-b57a-fe0cea13e1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:42:58.198644 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ff3b9724-5e76-4e53-b57a-fe0cea13e1f2 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:42:58.199835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ff3b9724-5e76-4e53-b57a-fe0cea13e1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:42:58.268910 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1415/2827] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:42:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:42:58.321419 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72e3b-a667-45da-9259-141d58b8fa2d service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:42:58.322816 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-04f72e3b-a667-45da-9259-141d58b8fa2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:42:58.403028 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72e3b-a667-45da-9259-141d58b8fa2d service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:42:58.409965 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d36eb-3919-4115-826b-c1050d5df315 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:42:58.410958 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d36eb-3919-4115-826b-c1050d5df315 service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:42:58.411235 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d36eb-3919-4115-826b-c1050d5df315 service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:42:58.411506 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d36eb-3919-4115-826b-c1050d5df315 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:42:58.421943 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d36eb-3919-4115-826b-c1050d5df315 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:42:58.423534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d36eb-3919-4115-826b-c1050d5df315 service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:42:58.431641 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1413/2828] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:42:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:43:08.265874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=44 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:08.428443 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=36 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:14.093565 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b9724-5e76-4e53-b57a-fe0cea13e1f2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:14.096283 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ff3b9724-5e76-4e53-b57a-fe0cea13e1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:14.175352 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b9724-5e76-4e53-b57a-fe0cea13e1f2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:14.179755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125bc84-2a6e-4acb-8d4d-ab32f9d536d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:14.180627 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125bc84-2a6e-4acb-8d4d-ab32f9d536d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:14.181466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125bc84-2a6e-4acb-8d4d-ab32f9d536d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:14.181466 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125bc84-2a6e-4acb-8d4d-ab32f9d536d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:14.183000 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3125bc84-2a6e-4acb-8d4d-ab32f9d536d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:14.203787 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125bc84-2a6e-4acb-8d4d-ab32f9d536d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:14.205365 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125bc84-2a6e-4acb-8d4d-ab32f9d536d8 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:14.216755 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1416/2829] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:43:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:43:14.344394 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb213-7a98-4642-8af4-1b0dfdfcb2db None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:14.344968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb213-7a98-4642-8af4-1b0dfdfcb2db None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:14.344968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eb213-7a98-4642-8af4-1b0dfdfcb2db None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:14.346368 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1414/2830] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:43:14.353217 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908b3e6-b296-46c6-8a65-6dfe46ed3f1e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:14.353504 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908b3e6-b296-46c6-8a65-6dfe46ed3f1e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:14.353774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908b3e6-b296-46c6-8a65-6dfe46ed3f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:14.409312 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5908b3e6-b296-46c6-8a65-6dfe46ed3f1e None None] MFA Rules not processed for user `37c4400204794a54957ccf28df938f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:43:14.411069 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5908b3e6-b296-46c6-8a65-6dfe46ed3f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:14.418195 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1417/2831] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:43:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:43:14.431457 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb213-7a98-4642-8af4-1b0dfdfcb2db None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:14.443252 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eb213-7a98-4642-8af4-1b0dfdfcb2db None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:14.447113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b04faf-3bcb-414c-96d5-2b1d5c41a0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:14.447956 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b04faf-3bcb-414c-96d5-2b1d5c41a0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:14.448460 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b04faf-3bcb-414c-96d5-2b1d5c41a0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:14.448905 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b04faf-3bcb-414c-96d5-2b1d5c41a0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:14.458495 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b04faf-3bcb-414c-96d5-2b1d5c41a0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:14.460385 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b04faf-3bcb-414c-96d5-2b1d5c41a0b1 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:14.471284 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1415/2832] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:43:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:43:15.568908 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ea1fe-b675-4abe-ab94-cb81576c9ffd None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:15.569445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ea1fe-b675-4abe-ab94-cb81576c9ffd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:15.569445 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ea1fe-b675-4abe-ab94-cb81576c9ffd None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:15.570824 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1418/2833] 10.222.0.39 () {54 vars in 921 bytes} [Sat Jun 4 18:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 18:43:15.578947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c09a7-c73e-44b1-b56d-7be137bff478 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:15.579504 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c09a7-c73e-44b1-b56d-7be137bff478 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:15.579682 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c09a7-c73e-44b1-b56d-7be137bff478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:15.600769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-053c09a7-c73e-44b1-b56d-7be137bff478 None None] MFA Rules not processed for user `311b3c1e00d64423865b35a188ede79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:43:15.601999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-053c09a7-c73e-44b1-b56d-7be137bff478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:15.611772 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1416/2834] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Jun 4 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:43:15.622379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ea1fe-b675-4abe-ab94-cb81576c9ffd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:15.634241 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ea1fe-b675-4abe-ab94-cb81576c9ffd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:15.637833 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d22c9-e861-4313-b817-33a59e1c5b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:15.638544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d22c9-e861-4313-b817-33a59e1c5b13 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:15.638889 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d22c9-e861-4313-b817-33a59e1c5b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:15.639233 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d22c9-e861-4313-b817-33a59e1c5b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:15.649851 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d22c9-e861-4313-b817-33a59e1c5b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:15.651280 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d22c9-e861-4313-b817-33a59e1c5b13 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:15.662678 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1419/2835] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:43:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:43:15.844537 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53502-112a-4045-bee7-7ab514c816df None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:15.844829 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53502-112a-4045-bee7-7ab514c816df None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:15.845215 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53502-112a-4045-bee7-7ab514c816df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:15.864083 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d5c53502-112a-4045-bee7-7ab514c816df None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:43:15.865365 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d5c53502-112a-4045-bee7-7ab514c816df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:15.873814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1417/2836] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:43:15.887657 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d22c9-e861-4313-b817-33a59e1c5b13 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:15.899869 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d22c9-e861-4313-b817-33a59e1c5b13 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:15.905892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aadc19-5786-4b09-b373-cfa87c306324 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:15.906685 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aadc19-5786-4b09-b373-cfa87c306324 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:15.906978 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aadc19-5786-4b09-b373-cfa87c306324 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:15.908105 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aadc19-5786-4b09-b373-cfa87c306324 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:15.917397 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aadc19-5786-4b09-b373-cfa87c306324 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:15.919262 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aadc19-5786-4b09-b373-cfa87c306324 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:15.929630 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1420/2837] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:43:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:43:25.858902 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=12 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:25.925498 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=51 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:36.549890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2afcfa-2427-49aa-a60a-45effe2fbf84 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:36.550396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2afcfa-2427-49aa-a60a-45effe2fbf84 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:36.550396 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2afcfa-2427-49aa-a60a-45effe2fbf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:36.569136 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8d2afcfa-2427-49aa-a60a-45effe2fbf84 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:43:36.570341 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8d2afcfa-2427-49aa-a60a-45effe2fbf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:36.578675 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1418/2838] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 4 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:43:36.594380 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aadc19-5786-4b09-b373-cfa87c306324 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:36.605511 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aadc19-5786-4b09-b373-cfa87c306324 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:36.613710 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230bc6e-e9dc-4717-9992-bd7017f55766 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:36.614329 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230bc6e-e9dc-4717-9992-bd7017f55766 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:36.614635 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230bc6e-e9dc-4717-9992-bd7017f55766 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:36.614905 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230bc6e-e9dc-4717-9992-bd7017f55766 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:36.624050 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230bc6e-e9dc-4717-9992-bd7017f55766 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:36.625684 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230bc6e-e9dc-4717-9992-bd7017f55766 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:36.634625 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1421/2839] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:43:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 18:43:40.164815 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2afcfa-2427-49aa-a60a-45effe2fbf84 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:40.166366 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8d2afcfa-2427-49aa-a60a-45effe2fbf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:40.177828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2afcfa-2427-49aa-a60a-45effe2fbf84 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:40.182026 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f9d33-7d99-47ad-9541-d8dab7254967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:40.182679 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f9d33-7d99-47ad-9541-d8dab7254967 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:40.182975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f9d33-7d99-47ad-9541-d8dab7254967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:40.183256 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f9d33-7d99-47ad-9541-d8dab7254967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:40.185533 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-791f9d33-7d99-47ad-9541-d8dab7254967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:40.250975 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f9d33-7d99-47ad-9541-d8dab7254967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:40.252478 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f9d33-7d99-47ad-9541-d8dab7254967 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:40.262882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1419/2840] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:43:46.630985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:46.986883 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230bc6e-e9dc-4717-9992-bd7017f55766 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:46.988374 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1230bc6e-e9dc-4717-9992-bd7017f55766 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:47.004119 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230bc6e-e9dc-4717-9992-bd7017f55766 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:47.010782 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15145849-e2bc-47aa-805b-2560dafd93b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:47.011470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15145849-e2bc-47aa-805b-2560dafd93b4 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:47.011754 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15145849-e2bc-47aa-805b-2560dafd93b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:47.012055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15145849-e2bc-47aa-805b-2560dafd93b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:47.014131 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-15145849-e2bc-47aa-805b-2560dafd93b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:47.027364 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15145849-e2bc-47aa-805b-2560dafd93b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:47.029181 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15145849-e2bc-47aa-805b-2560dafd93b4 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:47.038978 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f9d33-7d99-47ad-9541-d8dab7254967 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:47.041047 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-791f9d33-7d99-47ad-9541-d8dab7254967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:47.042548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1422/2841] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:43:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:43:47.055352 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f9d33-7d99-47ad-9541-d8dab7254967 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:47.061173 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:47.062158 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:47.062490 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:47.062716 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] PATH_INFO: `/v3/users/cf94c76ba04b403b91a7ff77a2f476e8` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:47.063904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf94c76ba04b403b91a7ff77a2f476e8)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:47.065962 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:47.117073 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf94c76ba04b403b91a7ff77a2f476e8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.128435 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf94c76ba04b403b91a7ff77a2f476e8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.138622 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf94c76ba04b403b91a7ff77a2f476e8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.145611 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf94c76ba04b403b91a7ff77a2f476e8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.146248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf94c76ba04b403b91a7ff77a2f476e8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.152294 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1420/2842] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:43:47 2022] DELETE /identity/v3/users/cf94c76ba04b403b91a7ff77a2f476e8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:43:47.343703 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15145849-e2bc-47aa-805b-2560dafd93b4 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:47.355324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15145849-e2bc-47aa-805b-2560dafd93b4 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:47.416402 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:47.417182 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:47.417448 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:47.417719 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] PATH_INFO: `/v3/projects/2829dcddd2864698b273038b8df5ce76` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:47.418881 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2829dcddd2864698b273038b8df5ce76)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:47.420823 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:47.470403 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2829dcddd2864698b273038b8df5ce76', 'request_id': 'req-81e8a9f3-edc5-4e48-867c-53020efab9f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.479835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2829dcddd2864698b273038b8df5ce76', 'request_id': 'req-81e8a9f3-edc5-4e48-867c-53020efab9f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.487882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2829dcddd2864698b273038b8df5ce76', 'request_id': 'req-81e8a9f3-edc5-4e48-867c-53020efab9f8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.498979 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] The token cache is being invalidate because project 2829dcddd2864698b273038b8df5ce76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:43:47.499264 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.499953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.501693 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1423/2843] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:43:47 2022] DELETE /identity/v3/projects/2829dcddd2864698b273038b8df5ce76 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:43:47.505847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:47.507428 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:47.522401 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8c4bb-9456-469c-84a3-958394db455d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:47.579415 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:47.580445 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:47.580730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:47.581009 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] PATH_INFO: `/v3/users/f7d53c86a3034809bb5ed8f6203ab15e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:47.582264 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d53c86a3034809bb5ed8f6203ab15e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:47.584459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:47.586561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:47.635890 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d53c86a3034809bb5ed8f6203ab15e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.648479 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d53c86a3034809bb5ed8f6203ab15e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.657799 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d53c86a3034809bb5ed8f6203ab15e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.665475 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d53c86a3034809bb5ed8f6203ab15e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.666110 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d53c86a3034809bb5ed8f6203ab15e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.672135 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1421/2844] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:43:47 2022] DELETE /identity/v3/users/f7d53c86a3034809bb5ed8f6203ab15e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 18:43:47.847437 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:43:47.849030 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:43:47.863629 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8a9f3-edc5-4e48-867c-53020efab9f8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:43:47.925968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:43:47.926752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:43:47.927074 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:43:47.927334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] PATH_INFO: `/v3/projects/93cb36d427514775934bfee90e3103ac` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:43:47.928560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=93cb36d427514775934bfee90e3103ac)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:43:47.930964 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:43:47.952517 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:47.979293 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93cb36d427514775934bfee90e3103ac', 'request_id': 'req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.987444 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93cb36d427514775934bfee90e3103ac', 'request_id': 'req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:47.994357 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93cb36d427514775934bfee90e3103ac', 'request_id': 'req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:48.005758 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] The token cache is being invalidate because project 93cb36d427514775934bfee90e3103ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:43:48.006151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:48.006976 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:43:48.008771 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1424/2845] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:43:47 2022] DELETE /identity/v3/projects/93cb36d427514775934bfee90e3103ac => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:43:57.669000 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:43:58.002768 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:33.301560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:33.303159 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:33.367182 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa87675-69a9-4fee-a49f-025ac8be01e4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:33.419900 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359a296-f008-4508-9eb4-db8ba62bf59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:33.420599 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a296-f008-4508-9eb4-db8ba62bf59a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:33.420882 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a296-f008-4508-9eb4-db8ba62bf59a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:33.421184 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a296-f008-4508-9eb4-db8ba62bf59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:33.423179 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7359a296-f008-4508-9eb4-db8ba62bf59a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:33.522763 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359a296-f008-4508-9eb4-db8ba62bf59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:33.524855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359a296-f008-4508-9eb4-db8ba62bf59a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:33.547651 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1422/2846] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:44:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:44:34.748040 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:34.749634 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:34.762451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59c3dc-14c8-4b0e-b01c-a53ed4ac8bea admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:34.766882 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb63ad4-3652-4975-9aea-4c84856bba38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:34.767525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb63ad4-3652-4975-9aea-4c84856bba38 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:34.767815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb63ad4-3652-4975-9aea-4c84856bba38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:34.768127 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb63ad4-3652-4975-9aea-4c84856bba38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:34.769993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4fb63ad4-3652-4975-9aea-4c84856bba38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:34.784417 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb63ad4-3652-4975-9aea-4c84856bba38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:34.786239 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb63ad4-3652-4975-9aea-4c84856bba38 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:34.797548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1425/2847] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:44:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:44:40.457855 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359a296-f008-4508-9eb4-db8ba62bf59a service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:40.459758 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7359a296-f008-4508-9eb4-db8ba62bf59a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:40.476066 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359a296-f008-4508-9eb4-db8ba62bf59a service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:40.482892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff7236-5657-4ade-a7da-6744fdfc67de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:40.483812 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7236-5657-4ade-a7da-6744fdfc67de service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:40.484198 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7236-5657-4ade-a7da-6744fdfc67de service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:40.484491 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7236-5657-4ade-a7da-6744fdfc67de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:40.487059 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0eff7236-5657-4ade-a7da-6744fdfc67de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:40.523116 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:40.553556 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff7236-5657-4ade-a7da-6744fdfc67de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:40.554991 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff7236-5657-4ade-a7da-6744fdfc67de service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:40.564683 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1423/2848] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:44:43.490483 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb63ad4-3652-4975-9aea-4c84856bba38 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:43.491946 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4fb63ad4-3652-4975-9aea-4c84856bba38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:43.510506 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb63ad4-3652-4975-9aea-4c84856bba38 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:43.520935 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:43.521886 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:43.522192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:43.522435 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] PATH_INFO: `/v3/users/6ceccf3f6ce044b98503b09b13cd2510` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:43.527169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ceccf3f6ce044b98503b09b13cd2510)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:43.529207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:43.583058 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ceccf3f6ce044b98503b09b13cd2510'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:44:43.583723 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ceccf3f6ce044b98503b09b13cd2510'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:44:43.597766 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ceccf3f6ce044b98503b09b13cd2510'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:44:43.598497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ceccf3f6ce044b98503b09b13cd2510'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:44:43.605655 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94d47c6f-4dfa-44c3-9883-b4b740a2ff47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ceccf3f6ce044b98503b09b13cd2510'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:44:43.620588 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1426/2849] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:44:43 2022] DELETE /identity/v3/users/6ceccf3f6ce044b98503b09b13cd2510 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:44:43.805595 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff7236-5657-4ade-a7da-6744fdfc67de service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:43.817164 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff7236-5657-4ade-a7da-6744fdfc67de service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:43.886764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:43.887628 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:43.887922 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:43.888224 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] PATH_INFO: `/v3/projects/1c1a5168618d4511a41baa4f25425b86` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:43.889432 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1a5168618d4511a41baa4f25425b86)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:43.891335 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:43.940050 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1a5168618d4511a41baa4f25425b86', 'request_id': 'req-9ea86de6-c548-4a97-8bb6-f66469cd07c9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:44:43.945138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1a5168618d4511a41baa4f25425b86', 'request_id': 'req-9ea86de6-c548-4a97-8bb6-f66469cd07c9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:44:43.951078 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1a5168618d4511a41baa4f25425b86', 'request_id': 'req-9ea86de6-c548-4a97-8bb6-f66469cd07c9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:44:43.966653 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] The token cache is being invalidate because project 1c1a5168618d4511a41baa4f25425b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:44:43.966934 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:44:43.967542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9ea86de6-c548-4a97-8bb6-f66469cd07c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:44:43.969106 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1424/2850] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:44:43 2022] DELETE /identity/v3/projects/1c1a5168618d4511a41baa4f25425b86 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:44:43.975168 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd595352-99e2-428b-8f8c-1ebfee650a77 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:43.975457 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd595352-99e2-428b-8f8c-1ebfee650a77 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:43.975731 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd595352-99e2-428b-8f8c-1ebfee650a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:44.014760 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cd595352-99e2-428b-8f8c-1ebfee650a77 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:44:44.015985 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cd595352-99e2-428b-8f8c-1ebfee650a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:44.081683 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1427/2851] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:44:44.090305 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc68c6-dcab-4c25-8c1c-d95bdae4ee5c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:44.090632 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc68c6-dcab-4c25-8c1c-d95bdae4ee5c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:44.090899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc68c6-dcab-4c25-8c1c-d95bdae4ee5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:44.110750 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-86dc68c6-dcab-4c25-8c1c-d95bdae4ee5c None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:44:44.112422 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-86dc68c6-dcab-4c25-8c1c-d95bdae4ee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:44.122461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1425/2852] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:44:44.127481 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd595352-99e2-428b-8f8c-1ebfee650a77 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:44.137810 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd595352-99e2-428b-8f8c-1ebfee650a77 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:44.144027 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd1898-e47b-4760-a625-435b5a6c7a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:44.144695 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd1898-e47b-4760-a625-435b5a6c7a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:44.144983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd1898-e47b-4760-a625-435b5a6c7a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:44.145254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd1898-e47b-4760-a625-435b5a6c7a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:44.145992 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd1898-e47b-4760-a625-435b5a6c7a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:44:44.146298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd1898-e47b-4760-a625-435b5a6c7a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:44.147933 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd1898-e47b-4760-a625-435b5a6c7a7d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:44.160700 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1428/2853] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:44:44.165027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc68c6-dcab-4c25-8c1c-d95bdae4ee5c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:44.175157 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc68c6-dcab-4c25-8c1c-d95bdae4ee5c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:44.180462 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7f189-90c0-44e6-b3c4-64a1f68de3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:44.181093 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f189-90c0-44e6-b3c4-64a1f68de3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:44.181372 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f189-90c0-44e6-b3c4-64a1f68de3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:44.181643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7f189-90c0-44e6-b3c4-64a1f68de3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:44.182339 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7f189-90c0-44e6-b3c4-64a1f68de3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:44.184272 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7f189-90c0-44e6-b3c4-64a1f68de3a9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:44.212915 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1426/2854] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:44:44 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:44:44.217207 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd1898-e47b-4760-a625-435b5a6c7a7d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:44.227974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd1898-e47b-4760-a625-435b5a6c7a7d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:44.258582 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:44.289451 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be9074-e698-44e8-8494-396d10dab4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:44.290125 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9074-e698-44e8-8494-396d10dab4cd admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:44.290398 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9074-e698-44e8-8494-396d10dab4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:44.290681 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9074-e698-44e8-8494-396d10dab4cd admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:44.291379 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be9074-e698-44e8-8494-396d10dab4cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:44.293348 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be9074-e698-44e8-8494-396d10dab4cd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:44.315621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1429/2855] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:44:44 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:44:44.319986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7f189-90c0-44e6-b3c4-64a1f68de3a9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:44.330665 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7f189-90c0-44e6-b3c4-64a1f68de3a9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:44.337029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a876a1-2b43-43a7-9748-fc6920d3897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:44.337888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a876a1-2b43-43a7-9748-fc6920d3897c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:44.338273 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a876a1-2b43-43a7-9748-fc6920d3897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:44.338643 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a876a1-2b43-43a7-9748-fc6920d3897c admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:44.339706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a876a1-2b43-43a7-9748-fc6920d3897c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:44.341983 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a876a1-2b43-43a7-9748-fc6920d3897c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:44.353914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1427/2856] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:44:44.358005 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be9074-e698-44e8-8494-396d10dab4cd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:44.368621 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be9074-e698-44e8-8494-396d10dab4cd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:44.374862 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666ee6d-e36f-42df-81d6-ed0c71d8e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:44.375525 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ee6d-e36f-42df-81d6-ed0c71d8e72a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:44.375814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ee6d-e36f-42df-81d6-ed0c71d8e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:44.376118 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666ee6d-e36f-42df-81d6-ed0c71d8e72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:44.376856 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666ee6d-e36f-42df-81d6-ed0c71d8e72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:44.378494 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666ee6d-e36f-42df-81d6-ed0c71d8e72a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:44.389726 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1430/2857] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:44:44.395813 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a876a1-2b43-43a7-9748-fc6920d3897c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:44.406644 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a876a1-2b43-43a7-9748-fc6920d3897c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:44.412248 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47eb12d-cd64-46ee-b046-511f35cac5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:44.413163 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47eb12d-cd64-46ee-b046-511f35cac5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:44.413455 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47eb12d-cd64-46ee-b046-511f35cac5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:44.413724 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47eb12d-cd64-46ee-b046-511f35cac5c0 admin admin] PATH_INFO: `/v3/projects/b343ebf1f80e474fa583574db40b1cba/users/73bfcdd0f3504778a4fc65dcf2471e77/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:44.429381 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47eb12d-cd64-46ee-b046-511f35cac5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b343ebf1f80e474fa583574db40b1cba, user_id=73bfcdd0f3504778a4fc65dcf2471e77, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:44.432456 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47eb12d-cd64-46ee-b046-511f35cac5c0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:44.443269 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:44.449421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1428/2858] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:44:44 2022] PUT /identity/v3/projects/b343ebf1f80e474fa583574db40b1cba/users/73bfcdd0f3504778a4fc65dcf2471e77/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:44:44.454792 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d332fed-b5cb-4c1c-85dd-4e2e9dc6621b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:44.455188 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d332fed-b5cb-4c1c-85dd-4e2e9dc6621b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:44.455470 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d332fed-b5cb-4c1c-85dd-4e2e9dc6621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:44.473774 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8d332fed-b5cb-4c1c-85dd-4e2e9dc6621b None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:44:44.474996 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8d332fed-b5cb-4c1c-85dd-4e2e9dc6621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:44.541671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1431/2859] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:44:44.551534 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47eb12d-cd64-46ee-b046-511f35cac5c0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:44.553349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a47eb12d-cd64-46ee-b046-511f35cac5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:44.613681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47eb12d-cd64-46ee-b046-511f35cac5c0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:44.617786 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad37c-7720-420b-ab8f-8d80ae85e03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:44.618459 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad37c-7720-420b-ab8f-8d80ae85e03e service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:44.618793 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad37c-7720-420b-ab8f-8d80ae85e03e service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:44.619068 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad37c-7720-420b-ab8f-8d80ae85e03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:44.628971 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ad37c-7720-420b-ab8f-8d80ae85e03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:44.630413 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ad37c-7720-420b-ab8f-8d80ae85e03e service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:44.639970 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1429/2860] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:44:45.274194 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaeda0d-03e9-46ab-80db-97ec3677eedf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:45.274488 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaeda0d-03e9-46ab-80db-97ec3677eedf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:45.274778 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaeda0d-03e9-46ab-80db-97ec3677eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:45.312821 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3eaeda0d-03e9-46ab-80db-97ec3677eedf None None] MFA Rules not processed for user `73bfcdd0f3504778a4fc65dcf2471e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:44:45.314071 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3eaeda0d-03e9-46ab-80db-97ec3677eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:45.386767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1432/2861] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:44:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:44:45.398253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad37c-7720-420b-ab8f-8d80ae85e03e service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:45.400058 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c72ad37c-7720-420b-ab8f-8d80ae85e03e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:45.458689 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad37c-7720-420b-ab8f-8d80ae85e03e service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:45.462751 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2132159-f1e0-4ffd-b39d-13043edacaaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:45.463408 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132159-f1e0-4ffd-b39d-13043edacaaa service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:45.463694 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132159-f1e0-4ffd-b39d-13043edacaaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:45.463973 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132159-f1e0-4ffd-b39d-13043edacaaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:45.472687 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2132159-f1e0-4ffd-b39d-13043edacaaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:45.474142 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2132159-f1e0-4ffd-b39d-13043edacaaa service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:45.482968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1430/2862] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:44:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:44:46.855622 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05500a10-0217-4e8a-8453-6be62b919560 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:46.856255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05500a10-0217-4e8a-8453-6be62b919560 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:46.856255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05500a10-0217-4e8a-8453-6be62b919560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:46.876640 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-05500a10-0217-4e8a-8453-6be62b919560 None None] MFA Rules not processed for user `73bfcdd0f3504778a4fc65dcf2471e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:44:46.878302 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-05500a10-0217-4e8a-8453-6be62b919560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:46.886743 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1433/2863] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:44:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:44:47.127401 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2132159-f1e0-4ffd-b39d-13043edacaaa service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:47.137271 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2132159-f1e0-4ffd-b39d-13043edacaaa service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:47.141717 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f717f6-b117-4c28-ba43-a83fa19f2c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:47.142349 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f717f6-b117-4c28-ba43-a83fa19f2c15 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:47.142704 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f717f6-b117-4c28-ba43-a83fa19f2c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:47.143094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f717f6-b117-4c28-ba43-a83fa19f2c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:47.145234 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-87f717f6-b117-4c28-ba43-a83fa19f2c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:47.154999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f717f6-b117-4c28-ba43-a83fa19f2c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:47.156461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f717f6-b117-4c28-ba43-a83fa19f2c15 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:47.165168 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1431/2864] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:44:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:44:47.478790 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05500a10-0217-4e8a-8453-6be62b919560 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:47.480453 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-05500a10-0217-4e8a-8453-6be62b919560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:47.522609 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:44:47.560801 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05500a10-0217-4e8a-8453-6be62b919560 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:47.565941 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9b1e3-6f89-4b3e-ba0a-51b79247d9f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:47.566590 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9b1e3-6f89-4b3e-ba0a-51b79247d9f8 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:47.566870 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9b1e3-6f89-4b3e-ba0a-51b79247d9f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:47.567140 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9b1e3-6f89-4b3e-ba0a-51b79247d9f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:47.568940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ddc9b1e3-6f89-4b3e-ba0a-51b79247d9f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:47.579874 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9b1e3-6f89-4b3e-ba0a-51b79247d9f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:47.581555 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9b1e3-6f89-4b3e-ba0a-51b79247d9f8 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:47.591549 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1434/2865] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:44:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:44:49.464186 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f717f6-b117-4c28-ba43-a83fa19f2c15 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:49.473507 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f717f6-b117-4c28-ba43-a83fa19f2c15 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:49.477636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971aeb-5245-4328-97fe-3a8679cbe8da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:49.478308 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971aeb-5245-4328-97fe-3a8679cbe8da service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:49.478591 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971aeb-5245-4328-97fe-3a8679cbe8da service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:49.478858 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971aeb-5245-4328-97fe-3a8679cbe8da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:49.480789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e3971aeb-5245-4328-97fe-3a8679cbe8da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:49.491910 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971aeb-5245-4328-97fe-3a8679cbe8da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:49.493392 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971aeb-5245-4328-97fe-3a8679cbe8da service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:49.501771 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1432/2866] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:44:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:44:50.168919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9b1e3-6f89-4b3e-ba0a-51b79247d9f8 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:44:50.170574 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ddc9b1e3-6f89-4b3e-ba0a-51b79247d9f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:50.257045 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9b1e3-6f89-4b3e-ba0a-51b79247d9f8 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:44:50.262691 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c199d8-ce3c-4a29-bd78-6569007cbd48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '311b3c1e00d64423865b35a188ede79a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:44:50.263327 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c199d8-ce3c-4a29-bd78-6569007cbd48 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:44:50.263580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c199d8-ce3c-4a29-bd78-6569007cbd48 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:44:50.263875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c199d8-ce3c-4a29-bd78-6569007cbd48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:44:50.265720 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-25c199d8-ce3c-4a29-bd78-6569007cbd48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:44:50.278940 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c199d8-ce3c-4a29-bd78-6569007cbd48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:44:50.280568 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c199d8-ce3c-4a29-bd78-6569007cbd48 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:44:50.292308 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1435/2867] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:44:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:44:59.498156 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=65 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:00.288639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=51 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:02.233508 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806bd03-224f-45e8-af78-6dffb93d1a37 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:02.234064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806bd03-224f-45e8-af78-6dffb93d1a37 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:02.234064 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806bd03-224f-45e8-af78-6dffb93d1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:02.252238 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8806bd03-224f-45e8-af78-6dffb93d1a37 None None] MFA Rules not processed for user `73bfcdd0f3504778a4fc65dcf2471e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:45:02.253449 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8806bd03-224f-45e8-af78-6dffb93d1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:02.261055 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1433/2868] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:45:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:45:12.246987 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:14.723250 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c199d8-ce3c-4a29-bd78-6569007cbd48 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:14.734401 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c199d8-ce3c-4a29-bd78-6569007cbd48 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:14.738924 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b797d-f2e6-4a27-b566-15c1b7eb8f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:14.739560 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b797d-f2e6-4a27-b566-15c1b7eb8f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:14.739836 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b797d-f2e6-4a27-b566-15c1b7eb8f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:14.740298 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b797d-f2e6-4a27-b566-15c1b7eb8f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:14.742595 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8c1b797d-f2e6-4a27-b566-15c1b7eb8f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:14.807055 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b797d-f2e6-4a27-b566-15c1b7eb8f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:14.808542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b797d-f2e6-4a27-b566-15c1b7eb8f58 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:14.817325 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1436/2869] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:45:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:45:23.521616 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b920d-791f-49a3-a9d7-3d71f03732e1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:23.522032 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b920d-791f-49a3-a9d7-3d71f03732e1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:23.522203 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b920d-791f-49a3-a9d7-3d71f03732e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:23.542810 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d66b920d-791f-49a3-a9d7-3d71f03732e1 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:45:23.544039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d66b920d-791f-49a3-a9d7-3d71f03732e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:23.604138 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1434/2870] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Jun 4 18:45:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:45:23.653742 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b797d-f2e6-4a27-b566-15c1b7eb8f58 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:23.655229 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8c1b797d-f2e6-4a27-b566-15c1b7eb8f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:23.729296 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b797d-f2e6-4a27-b566-15c1b7eb8f58 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:23.734961 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786ae7f-570d-4c9c-8287-43dabe1c867a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:23.735616 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ae7f-570d-4c9c-8287-43dabe1c867a service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:23.735898 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ae7f-570d-4c9c-8287-43dabe1c867a service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:23.736193 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ae7f-570d-4c9c-8287-43dabe1c867a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:23.745441 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786ae7f-570d-4c9c-8287-43dabe1c867a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:23.747031 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786ae7f-570d-4c9c-8287-43dabe1c867a service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:23.756350 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1437/2871] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:45:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:45:24.711904 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b920d-791f-49a3-a9d7-3d71f03732e1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:24.722023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b920d-791f-49a3-a9d7-3d71f03732e1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:24.725913 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d390f8-fcc3-4aba-a83e-8942d8fc1489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:24.726650 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d390f8-fcc3-4aba-a83e-8942d8fc1489 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:24.727185 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d390f8-fcc3-4aba-a83e-8942d8fc1489 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:24.727472 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d390f8-fcc3-4aba-a83e-8942d8fc1489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:24.729427 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d4d390f8-fcc3-4aba-a83e-8942d8fc1489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:24.742869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d390f8-fcc3-4aba-a83e-8942d8fc1489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:24.745051 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d390f8-fcc3-4aba-a83e-8942d8fc1489 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:24.757401 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1435/2872] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:45:28.753063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786ae7f-570d-4c9c-8287-43dabe1c867a service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:28.767235 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786ae7f-570d-4c9c-8287-43dabe1c867a service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:28.773269 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f23a8-7e42-4cca-b0a7-8e996304d7f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:28.774853 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f23a8-7e42-4cca-b0a7-8e996304d7f6 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:28.775317 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f23a8-7e42-4cca-b0a7-8e996304d7f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:28.775773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f23a8-7e42-4cca-b0a7-8e996304d7f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:28.777896 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-054f23a8-7e42-4cca-b0a7-8e996304d7f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:28.792446 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f23a8-7e42-4cca-b0a7-8e996304d7f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:28.794620 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f23a8-7e42-4cca-b0a7-8e996304d7f6 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:28.808647 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1438/2873] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:45:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:45:32.588874 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d390f8-fcc3-4aba-a83e-8942d8fc1489 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:32.591764 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d4d390f8-fcc3-4aba-a83e-8942d8fc1489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:32.608909 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d390f8-fcc3-4aba-a83e-8942d8fc1489 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:32.618449 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:32.619469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:32.619846 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:32.620286 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] PATH_INFO: `/v3/users/308d60778a0e489491cd6b3a79c96385` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:32.621814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=308d60778a0e489491cd6b3a79c96385)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:32.624441 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:32.703745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308d60778a0e489491cd6b3a79c96385'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:32.718147 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308d60778a0e489491cd6b3a79c96385'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:32.729397 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308d60778a0e489491cd6b3a79c96385'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:32.738242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308d60778a0e489491cd6b3a79c96385'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:32.739031 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308d60778a0e489491cd6b3a79c96385'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:32.746685 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1436/2874] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:45:32 2022] DELETE /identity/v3/users/308d60778a0e489491cd6b3a79c96385 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:45:32.956770 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f23a8-7e42-4cca-b0a7-8e996304d7f6 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:32.975082 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f23a8-7e42-4cca-b0a7-8e996304d7f6 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:33.047189 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:33.048095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:33.048376 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:33.048649 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] PATH_INFO: `/v3/projects/b1701547610945ceac41e94e733f61a1` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:33.049830 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1701547610945ceac41e94e733f61a1)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:33.051750 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:33.080000 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:33.142977 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1701547610945ceac41e94e733f61a1', 'request_id': 'req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.151891 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1701547610945ceac41e94e733f61a1', 'request_id': 'req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.159093 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1701547610945ceac41e94e733f61a1', 'request_id': 'req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.172043 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] The token cache is being invalidate because project b1701547610945ceac41e94e733f61a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:45:33.172266 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.172903 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.174671 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1439/2875] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:45:32 2022] DELETE /identity/v3/projects/b1701547610945ceac41e94e733f61a1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:45:33.178635 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:33.180344 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:33.194789 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4ce3c-666e-4cbb-974d-a4b867989ebb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:33.262999 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:33.264167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:33.264502 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:33.264947 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] PATH_INFO: `/v3/users/d4b5b3c24e014b5ea7f3baf7868e18ee` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:33.266714 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b5b3c24e014b5ea7f3baf7868e18ee)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:33.268730 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:33.274956 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:33.331614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b5b3c24e014b5ea7f3baf7868e18ee'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.348314 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b5b3c24e014b5ea7f3baf7868e18ee'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.359191 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b5b3c24e014b5ea7f3baf7868e18ee'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.370268 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b5b3c24e014b5ea7f3baf7868e18ee'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.371127 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e9cdb43-c20e-4ea7-b60a-5d1300f8dbb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b5b3c24e014b5ea7f3baf7868e18ee'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.378010 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1437/2876] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:45:33 2022] DELETE /identity/v3/users/d4b5b3c24e014b5ea7f3baf7868e18ee => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:45:33.602367 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:33.604607 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:33.622969 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebb8f4-3a75-40cc-984d-5bb63b7cb8c9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:33.710741 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:33.712106 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:33.712639 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:33.713044 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] PATH_INFO: `/v3/projects/b73439ed6bab4bcfb172b669543c1c6b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:33.714708 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b73439ed6bab4bcfb172b669543c1c6b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:33.716815 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:33.772875 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b73439ed6bab4bcfb172b669543c1c6b', 'request_id': 'req-852ae055-c6d3-4315-829d-1516826f54b2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.783628 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b73439ed6bab4bcfb172b669543c1c6b', 'request_id': 'req-852ae055-c6d3-4315-829d-1516826f54b2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.792443 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b73439ed6bab4bcfb172b669543c1c6b', 'request_id': 'req-852ae055-c6d3-4315-829d-1516826f54b2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.806387 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] The token cache is being invalidate because project b73439ed6bab4bcfb172b669543c1c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:45:33.806692 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.807395 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:33.809003 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1440/2877] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:45:33 2022] DELETE /identity/v3/projects/b73439ed6bab4bcfb172b669543c1c6b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:45:40.351822 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e164b1-5c18-49d7-8437-5b0769a33f94 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:40.352380 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e164b1-5c18-49d7-8437-5b0769a33f94 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:40.352516 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e164b1-5c18-49d7-8437-5b0769a33f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:40.371039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-36e164b1-5c18-49d7-8437-5b0769a33f94 None None] MFA Rules not processed for user `733086955e19437e845f4f77c1178116`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:45:40.372276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-36e164b1-5c18-49d7-8437-5b0769a33f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:40.436780 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1438/2878] 10.222.0.39 () {58 vars in 967 bytes} [Sat Jun 4 18:45:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:45:40.449775 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:40.451968 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:40.495510 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:40.528137 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ae055-c6d3-4315-829d-1516826f54b2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:40.533320 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be511-d18c-4dac-a76e-aa2d0b1f7632 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a79a7fbb30b45cd8677d84dd1b5c008', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:40.533965 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be511-d18c-4dac-a76e-aa2d0b1f7632 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:40.534248 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be511-d18c-4dac-a76e-aa2d0b1f7632 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:40.534524 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be511-d18c-4dac-a76e-aa2d0b1f7632 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:40.543129 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0be511-d18c-4dac-a76e-aa2d0b1f7632 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:40.544757 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0be511-d18c-4dac-a76e-aa2d0b1f7632 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:40.553090 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1441/2879] 10.222.0.39 () {60 vars in 1384 bytes} [Sat Jun 4 18:45:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 18:45:42.543376 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e164b1-5c18-49d7-8437-5b0769a33f94 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:42.544892 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-36e164b1-5c18-49d7-8437-5b0769a33f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:42.611766 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e164b1-5c18-49d7-8437-5b0769a33f94 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:42.616917 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:42.617796 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:42.618075 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:42.618348 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] PATH_INFO: `/v3/users/73bfcdd0f3504778a4fc65dcf2471e77` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:42.619854 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bfcdd0f3504778a4fc65dcf2471e77)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:42.621833 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:42.659152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:42.676258 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bfcdd0f3504778a4fc65dcf2471e77'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:42.688518 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bfcdd0f3504778a4fc65dcf2471e77'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:42.698253 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bfcdd0f3504778a4fc65dcf2471e77'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:42.708681 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bfcdd0f3504778a4fc65dcf2471e77'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:42.709614 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f5983508-07d1-4a1a-b0bf-29f528fa3c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bfcdd0f3504778a4fc65dcf2471e77'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:42.717039 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1439/2880] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:45:42 2022] DELETE /identity/v3/users/73bfcdd0f3504778a4fc65dcf2471e77 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:45:42.899334 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be511-d18c-4dac-a76e-aa2d0b1f7632 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:42.913252 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be511-d18c-4dac-a76e-aa2d0b1f7632 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:42.972663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:42.973596 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:42.973880 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:42.974156 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] PATH_INFO: `/v3/projects/b343ebf1f80e474fa583574db40b1cba` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:42.975340 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b343ebf1f80e474fa583574db40b1cba)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:42.977330 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:43.027192 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b343ebf1f80e474fa583574db40b1cba', 'request_id': 'req-11cd136f-1c6d-4b63-ad6c-733d767fb016'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:43.038674 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b343ebf1f80e474fa583574db40b1cba', 'request_id': 'req-11cd136f-1c6d-4b63-ad6c-733d767fb016'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:43.045400 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b343ebf1f80e474fa583574db40b1cba', 'request_id': 'req-11cd136f-1c6d-4b63-ad6c-733d767fb016'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:43.059499 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] The token cache is being invalidate because project b343ebf1f80e474fa583574db40b1cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:45:43.059795 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:43.060765 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-11cd136f-1c6d-4b63-ad6c-733d767fb016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:43.063070 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1442/2881] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:45:42 2022] DELETE /identity/v3/projects/b343ebf1f80e474fa583574db40b1cba => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:45:43.068906 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda02f3-2282-476f-a3f8-daa6fdd1fe56 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:43.069193 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda02f3-2282-476f-a3f8-daa6fdd1fe56 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:43.069461 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda02f3-2282-476f-a3f8-daa6fdd1fe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:43.089529 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4fda02f3-2282-476f-a3f8-daa6fdd1fe56 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:45:43.090881 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4fda02f3-2282-476f-a3f8-daa6fdd1fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:43.159896 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1440/2882] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:45:43.170255 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68788-f007-4f0c-9cb2-a30f23f59312 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:43.170542 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68788-f007-4f0c-9cb2-a30f23f59312 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:43.170819 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68788-f007-4f0c-9cb2-a30f23f59312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:43.192031 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-aab68788-f007-4f0c-9cb2-a30f23f59312 None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:45:43.193263 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aab68788-f007-4f0c-9cb2-a30f23f59312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:43.202051 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1443/2883] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 18:45:43.206514 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda02f3-2282-476f-a3f8-daa6fdd1fe56 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:43.217095 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda02f3-2282-476f-a3f8-daa6fdd1fe56 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:43.222986 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228faa8-fe05-47fd-a8b6-143a61787459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:43.223657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228faa8-fe05-47fd-a8b6-143a61787459 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:43.223941 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228faa8-fe05-47fd-a8b6-143a61787459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:43.224243 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228faa8-fe05-47fd-a8b6-143a61787459 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:43.224979 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228faa8-fe05-47fd-a8b6-143a61787459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:45:43.225290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228faa8-fe05-47fd-a8b6-143a61787459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:43.226914 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228faa8-fe05-47fd-a8b6-143a61787459 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:43.240811 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1441/2884] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:45:43.245351 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab68788-f007-4f0c-9cb2-a30f23f59312 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:43.254762 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab68788-f007-4f0c-9cb2-a30f23f59312 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:43.260092 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77878a-4481-4ec1-94b6-f16efb2c4f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:43.260734 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77878a-4481-4ec1-94b6-f16efb2c4f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:43.261014 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77878a-4481-4ec1-94b6-f16efb2c4f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:43.261285 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77878a-4481-4ec1-94b6-f16efb2c4f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:43.261993 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77878a-4481-4ec1-94b6-f16efb2c4f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:43.263895 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77878a-4481-4ec1-94b6-f16efb2c4f69 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:43.292947 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1444/2885] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:45:43 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:45:43.301842 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228faa8-fe05-47fd-a8b6-143a61787459 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:43.312596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228faa8-fe05-47fd-a8b6-143a61787459 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:43.369384 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe80a8-e44d-46c8-8404-d340bc2ef3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:43.370052 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe80a8-e44d-46c8-8404-d340bc2ef3fb admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:43.370332 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe80a8-e44d-46c8-8404-d340bc2ef3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:43.370588 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe80a8-e44d-46c8-8404-d340bc2ef3fb admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:43.371279 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe80a8-e44d-46c8-8404-d340bc2ef3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:43.373244 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe80a8-e44d-46c8-8404-d340bc2ef3fb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:43.393742 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1442/2886] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:45:43 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:45:43.397976 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77878a-4481-4ec1-94b6-f16efb2c4f69 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:43.408745 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77878a-4481-4ec1-94b6-f16efb2c4f69 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:43.414532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a7c54-4ba5-410a-8ed1-c703ebf39697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:43.415190 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a7c54-4ba5-410a-8ed1-c703ebf39697 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:43.415469 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a7c54-4ba5-410a-8ed1-c703ebf39697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:43.415767 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a7c54-4ba5-410a-8ed1-c703ebf39697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:43.416690 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a7c54-4ba5-410a-8ed1-c703ebf39697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:43.418300 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a7c54-4ba5-410a-8ed1-c703ebf39697 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:43.429015 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1445/2887] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:45:43.433617 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe80a8-e44d-46c8-8404-d340bc2ef3fb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:43.444587 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe80a8-e44d-46c8-8404-d340bc2ef3fb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:43.450094 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020697c-5962-49b3-9e5b-1611937134e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:43.450761 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020697c-5962-49b3-9e5b-1611937134e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:43.451048 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020697c-5962-49b3-9e5b-1611937134e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:43.451327 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020697c-5962-49b3-9e5b-1611937134e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:43.452131 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020697c-5962-49b3-9e5b-1611937134e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:43.453748 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020697c-5962-49b3-9e5b-1611937134e9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:43.464275 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1443/2888] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:45:43.468462 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a7c54-4ba5-410a-8ed1-c703ebf39697 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:43.478425 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a7c54-4ba5-410a-8ed1-c703ebf39697 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:43.483890 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79da4c-4402-4eec-9805-8e1fcaea69ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:43.484814 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79da4c-4402-4eec-9805-8e1fcaea69ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:43.485095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79da4c-4402-4eec-9805-8e1fcaea69ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:43.485397 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79da4c-4402-4eec-9805-8e1fcaea69ff admin admin] PATH_INFO: `/v3/projects/5ca6a4ead55b45cf865ea1cc06958d69/users/47f319ed5fb844aa82c7724e9a02c63b/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:43.497580 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:43.500602 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79da4c-4402-4eec-9805-8e1fcaea69ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca6a4ead55b45cf865ea1cc06958d69, user_id=47f319ed5fb844aa82c7724e9a02c63b, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:43.504148 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79da4c-4402-4eec-9805-8e1fcaea69ff admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:43.520164 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1446/2889] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:45:43 2022] PUT /identity/v3/projects/5ca6a4ead55b45cf865ea1cc06958d69/users/47f319ed5fb844aa82c7724e9a02c63b/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:45:43.530773 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bee73-31a4-4dbe-89f6-0b35888defe2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:43.531065 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bee73-31a4-4dbe-89f6-0b35888defe2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:43.531371 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bee73-31a4-4dbe-89f6-0b35888defe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:43.556670 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:43.560420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7c0bee73-31a4-4dbe-89f6-0b35888defe2 None None] MFA Rules not processed for user `47f319ed5fb844aa82c7724e9a02c63b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:45:43.562411 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7c0bee73-31a4-4dbe-89f6-0b35888defe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:43.631499 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1444/2890] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:45:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:45:43.643095 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79da4c-4402-4eec-9805-8e1fcaea69ff admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:43.645087 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1e79da4c-4402-4eec-9805-8e1fcaea69ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:43.708986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79da4c-4402-4eec-9805-8e1fcaea69ff admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:43.713623 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d6559-9321-49f5-8378-4ad28d3a7658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43023787db0749e8be546755f521755b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:43.714471 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d6559-9321-49f5-8378-4ad28d3a7658 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:43.714759 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d6559-9321-49f5-8378-4ad28d3a7658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:43.715063 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d6559-9321-49f5-8378-4ad28d3a7658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:43.725827 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d6559-9321-49f5-8378-4ad28d3a7658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:43.727892 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d6559-9321-49f5-8378-4ad28d3a7658 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:43.739744 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1447/2891] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:45:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:45:46.328071 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bee73-31a4-4dbe-89f6-0b35888defe2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:46.402451 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bee73-31a4-4dbe-89f6-0b35888defe2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:46.408242 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:46.409133 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:46.409414 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:46.409686 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] PATH_INFO: `/v3/users/47f319ed5fb844aa82c7724e9a02c63b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:46.411420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f319ed5fb844aa82c7724e9a02c63b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:46.413400 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:46.473383 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f319ed5fb844aa82c7724e9a02c63b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:46.490820 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f319ed5fb844aa82c7724e9a02c63b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:46.503469 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f319ed5fb844aa82c7724e9a02c63b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:46.511420 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f319ed5fb844aa82c7724e9a02c63b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:46.512102 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f319ed5fb844aa82c7724e9a02c63b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:46.518957 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1445/2892] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:45:46 2022] DELETE /identity/v3/users/47f319ed5fb844aa82c7724e9a02c63b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:45:46.524553 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc446-fe52-4dfa-af3f-ce06eb02cfcb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:46.525049 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc446-fe52-4dfa-af3f-ce06eb02cfcb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:46.525150 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc446-fe52-4dfa-af3f-ce06eb02cfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:46.546391 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-eb0bc446-fe52-4dfa-af3f-ce06eb02cfcb None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:45:46.547581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eb0bc446-fe52-4dfa-af3f-ce06eb02cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:46.624772 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1448/2893] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:45:46.635825 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:46.637513 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:46.665660 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:46.708274 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc9044-70ec-4f53-9875-b1a63831cd86 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:46.712121 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ad3af-4ea0-49d3-8cd1-3f33553dc7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:46.712770 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad3af-4ea0-49d3-8cd1-3f33553dc7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:46.713053 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad3af-4ea0-49d3-8cd1-3f33553dc7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:46.713426 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ad3af-4ea0-49d3-8cd1-3f33553dc7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:46.723081 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ad3af-4ea0-49d3-8cd1-3f33553dc7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:46.724568 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ad3af-4ea0-49d3-8cd1-3f33553dc7f9 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:46.734657 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1446/2894] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:45:47.009324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bc446-fe52-4dfa-af3f-ce06eb02cfcb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:47.010953 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eb0bc446-fe52-4dfa-af3f-ce06eb02cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:47.024884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bc446-fe52-4dfa-af3f-ce06eb02cfcb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:47.034974 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:47.036304 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.036514 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.036773 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] PATH_INFO: `/v3/projects/5ca6a4ead55b45cf865ea1cc06958d69` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.038169 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca6a4ead55b45cf865ea1cc06958d69)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:47.040151 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:47.089638 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca6a4ead55b45cf865ea1cc06958d69', 'request_id': 'req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:47.098812 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca6a4ead55b45cf865ea1cc06958d69', 'request_id': 'req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:47.108271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca6a4ead55b45cf865ea1cc06958d69', 'request_id': 'req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:47.120601 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] The token cache is being invalidate because project 5ca6a4ead55b45cf865ea1cc06958d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:45:47.120900 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:47.121659 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-eb1344ca-8f3c-4e17-aca9-8ea1bd05a870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:45:47.123324 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1449/2895] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:45:47 2022] DELETE /identity/v3/projects/5ca6a4ead55b45cf865ea1cc06958d69 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:45:47.128633 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d81ee-229e-4574-a279-77e8da91b6db None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.128843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d81ee-229e-4574-a279-77e8da91b6db None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.129115 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d81ee-229e-4574-a279-77e8da91b6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.148221 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6c6d81ee-229e-4574-a279-77e8da91b6db None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:45:47.149421 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6c6d81ee-229e-4574-a279-77e8da91b6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:47.214290 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1447/2896] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:45:47.225532 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0f7b9-d0d4-478c-a39e-abf3249261bb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.225818 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0f7b9-d0d4-478c-a39e-abf3249261bb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.226089 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0f7b9-d0d4-478c-a39e-abf3249261bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.246581 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-89e0f7b9-d0d4-478c-a39e-abf3249261bb None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:45:47.247781 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-89e0f7b9-d0d4-478c-a39e-abf3249261bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:47.256098 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1450/2897] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:45:47.260843 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d81ee-229e-4574-a279-77e8da91b6db None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:47.271023 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d81ee-229e-4574-a279-77e8da91b6db None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:47.278095 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800992a8-9c10-4489-af62-39e4a7743eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:47.279310 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800992a8-9c10-4489-af62-39e4a7743eef admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.279597 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800992a8-9c10-4489-af62-39e4a7743eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.279866 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800992a8-9c10-4489-af62-39e4a7743eef admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.280627 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800992a8-9c10-4489-af62-39e4a7743eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 18:45:47.280932 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800992a8-9c10-4489-af62-39e4a7743eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:47.282583 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800992a8-9c10-4489-af62-39e4a7743eef admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:47.295539 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1448/2898] 10.222.0.39 () {58 vars in 1152 bytes} [Sat Jun 4 18:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 18:45:47.299984 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0f7b9-d0d4-478c-a39e-abf3249261bb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:47.310626 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0f7b9-d0d4-478c-a39e-abf3249261bb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:47.316604 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa04b3-f5d7-4098-a3c4-38e17f7aae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:47.317260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa04b3-f5d7-4098-a3c4-38e17f7aae56 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.317537 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa04b3-f5d7-4098-a3c4-38e17f7aae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.317808 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa04b3-f5d7-4098-a3c4-38e17f7aae56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.318502 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa04b3-f5d7-4098-a3c4-38e17f7aae56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:47.320515 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa04b3-f5d7-4098-a3c4-38e17f7aae56 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:47.329301 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:47.349430 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1451/2899] 10.222.0.39 () {60 vars in 1152 bytes} [Sat Jun 4 18:45:47 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:45:47.353706 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800992a8-9c10-4489-af62-39e4a7743eef admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:47.364250 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800992a8-9c10-4489-af62-39e4a7743eef admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:47.426899 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd7057-05f0-437f-8c5c-7d44c8022556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:47.427571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd7057-05f0-437f-8c5c-7d44c8022556 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.427849 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd7057-05f0-437f-8c5c-7d44c8022556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.428152 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd7057-05f0-437f-8c5c-7d44c8022556 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.428840 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd7057-05f0-437f-8c5c-7d44c8022556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:47.430769 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd7057-05f0-437f-8c5c-7d44c8022556 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:47.453560 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1449/2900] 10.222.0.39 () {60 vars in 1143 bytes} [Sat Jun 4 18:45:47 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 18:45:47.457540 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa04b3-f5d7-4098-a3c4-38e17f7aae56 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:47.469645 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa04b3-f5d7-4098-a3c4-38e17f7aae56 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:47.474975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830b975-1814-405b-8619-e23bc53410a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:47.475957 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830b975-1814-405b-8619-e23bc53410a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.476305 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830b975-1814-405b-8619-e23bc53410a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.476584 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830b975-1814-405b-8619-e23bc53410a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.477339 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830b975-1814-405b-8619-e23bc53410a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:47.479085 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830b975-1814-405b-8619-e23bc53410a7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:47.489682 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1452/2901] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:45:47.493745 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd7057-05f0-437f-8c5c-7d44c8022556 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:47.504237 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd7057-05f0-437f-8c5c-7d44c8022556 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:47.509705 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44870f3b-8a14-44a3-99d8-e51a1968d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:47.510603 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44870f3b-8a14-44a3-99d8-e51a1968d2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.510888 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44870f3b-8a14-44a3-99d8-e51a1968d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.511166 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44870f3b-8a14-44a3-99d8-e51a1968d2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.511908 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44870f3b-8a14-44a3-99d8-e51a1968d2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:47.513572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44870f3b-8a14-44a3-99d8-e51a1968d2ea admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:47.523968 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1450/2902] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 4 18:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 18:45:47.528183 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830b975-1814-405b-8619-e23bc53410a7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:47.539060 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830b975-1814-405b-8619-e23bc53410a7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:47.545097 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b003-7fe7-4520-a7e9-e0fff505b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:47.545983 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b003-7fe7-4520-a7e9-e0fff505b60e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.546260 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b003-7fe7-4520-a7e9-e0fff505b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.546527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b003-7fe7-4520-a7e9-e0fff505b60e admin admin] PATH_INFO: `/v3/projects/a41eda4b7ee1454e87c610ac2fc8b0f3/users/04ad3676be8e44a18d8f11dba67b0739/roles/e0e319e010e342d184a4b77ac79ecf84` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.562843 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1b003-7fe7-4520-a7e9-e0fff505b60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41eda4b7ee1454e87c610ac2fc8b0f3, user_id=04ad3676be8e44a18d8f11dba67b0739, role_id=e0e319e010e342d184a4b77ac79ecf84)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:47.565545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1b003-7fe7-4520-a7e9-e0fff505b60e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:47.581153 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1453/2903] 10.222.0.39 () {60 vars in 1482 bytes} [Sat Jun 4 18:45:47 2022] PUT /identity/v3/projects/a41eda4b7ee1454e87c610ac2fc8b0f3/users/04ad3676be8e44a18d8f11dba67b0739/roles/e0e319e010e342d184a4b77ac79ecf84 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:45:47.593303 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ee17d-f968-4a00-b4eb-9f1b62254c81 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.593592 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ee17d-f968-4a00-b4eb-9f1b62254c81 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.593870 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ee17d-f968-4a00-b4eb-9f1b62254c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.623585 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-915ee17d-f968-4a00-b4eb-9f1b62254c81 None None] MFA Rules not processed for user `04ad3676be8e44a18d8f11dba67b0739`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:45:47.624828 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-915ee17d-f968-4a00-b4eb-9f1b62254c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:47.644390 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:47.694027 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1451/2904] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:45:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:45:47.706545 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b003-7fe7-4520-a7e9-e0fff505b60e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:45:47.709497 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-72b1b003-7fe7-4520-a7e9-e0fff505b60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:45:47.795527 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b003-7fe7-4520-a7e9-e0fff505b60e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:45:47.799919 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89e6cf-1a25-43be-b64f-b582c983c29a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4adc107bf542b8bb0502c7fbf94431', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:45:47.800598 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89e6cf-1a25-43be-b64f-b582c983c29a service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:45:47.800884 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89e6cf-1a25-43be-b64f-b582c983c29a service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:45:47.801158 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89e6cf-1a25-43be-b64f-b582c983c29a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:45:47.814362 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89e6cf-1a25-43be-b64f-b582c983c29a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:45:47.815828 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89e6cf-1a25-43be-b64f-b582c983c29a service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:45:47.826254 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1454/2905] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:45:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:45:57.690636 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=18 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:45:57.821271 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:46:18.967465 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ee17d-f968-4a00-b4eb-9f1b62254c81 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:46:19.033594 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ee17d-f968-4a00-b4eb-9f1b62254c81 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:46:19.038869 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:46:19.039739 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:46:19.040029 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:46:19.040326 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] PATH_INFO: `/v3/users/04ad3676be8e44a18d8f11dba67b0739` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:46:19.041548 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ad3676be8e44a18d8f11dba67b0739)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:46:19.043492 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:46:19.097572 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ad3676be8e44a18d8f11dba67b0739'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:46:19.110545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ad3676be8e44a18d8f11dba67b0739'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:46:19.121276 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ad3676be8e44a18d8f11dba67b0739'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:46:19.128298 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ad3676be8e44a18d8f11dba67b0739'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:46:19.128924 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ad3676be8e44a18d8f11dba67b0739'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:46:19.134847 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1452/2906] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 4 18:46:18 2022] DELETE /identity/v3/users/04ad3676be8e44a18d8f11dba67b0739 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:46:19.139503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0784-3865-4a81-8b64-32a315ab49ff None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:46:19.140054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0784-3865-4a81-8b64-32a315ab49ff None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:46:19.140162 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0784-3865-4a81-8b64-32a315ab49ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:46:19.158715 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b52c0784-3865-4a81-8b64-32a315ab49ff None None] MFA Rules not processed for user `ad4863301fe44ec5b40adc370b3a51b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 18:46:19.159932 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b52c0784-3865-4a81-8b64-32a315ab49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:46:19.220835 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1455/2907] 10.222.0.39 () {58 vars in 957 bytes} [Sat Jun 4 18:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 18:46:19.231097 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:46:19.233122 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:46:19.296542 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b42849-7ce5-4408-b9b8-03ce463a0a8c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:46:19.300596 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445ffd2-f161-48fd-b50b-7e6641bdcb36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c4400204794a54957ccf28df938f46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:46:19.301281 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445ffd2-f161-48fd-b50b-7e6641bdcb36 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:46:19.301561 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445ffd2-f161-48fd-b50b-7e6641bdcb36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:46:19.301814 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445ffd2-f161-48fd-b50b-7e6641bdcb36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:46:19.312879 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445ffd2-f161-48fd-b50b-7e6641bdcb36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:46:19.315113 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445ffd2-f161-48fd-b50b-7e6641bdcb36 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:46:19.329794 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1453/2908] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:46:19.615544 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0784-3865-4a81-8b64-32a315ab49ff None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:46:19.617503 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b52c0784-3865-4a81-8b64-32a315ab49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:46:19.630386 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0784-3865-4a81-8b64-32a315ab49ff None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:46:19.635663 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4863301fe44ec5b40adc370b3a51b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b474e20b865e43bf8fbbb839d2f225c5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:46:19.636709 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:46:19.637054 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:46:19.637411 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] PATH_INFO: `/v3/projects/a41eda4b7ee1454e87c610ac2fc8b0f3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:46:19.638822 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41eda4b7ee1454e87c610ac2fc8b0f3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:46:19.640986 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:46:19.694267 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41eda4b7ee1454e87c610ac2fc8b0f3', 'request_id': 'req-26e86d51-2ecf-4b1a-9e17-3a9940b24384'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:46:19.702975 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41eda4b7ee1454e87c610ac2fc8b0f3', 'request_id': 'req-26e86d51-2ecf-4b1a-9e17-3a9940b24384'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:46:19.709442 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41eda4b7ee1454e87c610ac2fc8b0f3', 'request_id': 'req-26e86d51-2ecf-4b1a-9e17-3a9940b24384'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:46:19.724550 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] The token cache is being invalidate because project a41eda4b7ee1454e87c610ac2fc8b0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 18:46:19.724752 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:46:19.725548 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-26e86d51-2ecf-4b1a-9e17-3a9940b24384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 18:46:19.727253 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1456/2909] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 4 18:46:19 2022] DELETE /identity/v3/projects/a41eda4b7ee1454e87c610ac2fc8b0f3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 18:46:29.323571 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:46:29.720203 dv-cinder-790535-41-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 18:47:12.273933 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445ffd2-f161-48fd-b50b-7e6641bdcb36 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 18:47:12.276985 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2445ffd2-f161-48fd-b50b-7e6641bdcb36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:47:12.355732 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445ffd2-f161-48fd-b50b-7e6641bdcb36 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 18:47:12.417951 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7826887-7d98-4b54-ad93-5b7b29b7428c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9edcf71253ee4c81a402fffe13128b97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1d869e2da6945caba000577ff12025c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 18:47:12.418611 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7826887-7d98-4b54-ad93-5b7b29b7428c service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 18:47:12.418889 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7826887-7d98-4b54-ad93-5b7b29b7428c service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 18:47:12.419167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7826887-7d98-4b54-ad93-5b7b29b7428c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 18:47:12.421167 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c7826887-7d98-4b54-ad93-5b7b29b7428c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 18:47:12.433005 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7826887-7d98-4b54-ad93-5b7b29b7428c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 18:47:12.434600 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7826887-7d98-4b54-ad93-5b7b29b7428c service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 18:47:12.444545 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1454/2910] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Jun 4 18:47:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 18:47:22.440547 dv-cinder-790535-41-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=58 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}